[2024-12-10 12:18:20.694970] Starting SPDK v25.01-pre git sha1 52a413487 / DPDK 24.03.0 initialization... [2024-12-10 12:18:20.695236] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1479142 ] Set seed to 1733829500688215 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-10 12:18:20.832043] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-10 12:18:20.939805] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-10 12:18:20.939853] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1479142' to capture a snapshot of events at runtime. [2024-12-10 12:18:20.939863] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-10 12:18:20.939874] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-10 12:18:20.939882] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1479142 for offline analysis/debug. [2024-12-10 12:18:20.941442] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 10 12:18:26 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/10-12:18:33 ... thread 0: (1000000,1000000) ops and (144936.8,144936.8) ops/second in (6.899557,6.899557) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 1.31 GB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 139.6 6.30 2.46 10 0.630 0 0 0.0 0.0 L1 3/3 138.87 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 36/7 2.11 GB 1.7 2.7 2.5 0.2 2.7 2.4 0.0 1.1 111.3 109.2 25.13 13.25 8 3.141 1401K 0 0.0 0.0 L4 165/21 12.08 GB 1.1 3.3 1.8 1.5 3.0 1.5 0.4 1.7 140.1 128.0 24.12 14.66 14 1.723 606K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 331/44 24.87 GB 0.0 6.0 4.2 1.8 6.6 4.8 0.4 7.6 111.2 120.8 55.55 30.38 32 1.736 2008K 0 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 4.2 1.8 6.6 4.8 0.4 7.6 111.2 120.8 55.55 30.38 32 1.736 2008K 0 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 4.2 1.8 5.7 3.9 0.0 0.0 125.4 118.4 49.25 27.91 22 2.239 2008K 0 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 139.6 6.30 2.46 10 0.630 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.0 total, 6.9 interval Flush(GB): cumulative 0.859, interval 0.859 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.55 GB write, 954.93 MB/s write, 6.03 GB read, 878.94 MB/s read, 55.6 seconds Interval compaction: 6.55 GB write, 972.02 MB/s write, 6.03 GB read, 894.67 MB/s read, 55.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 111598 Average: 108.3446 StdDev: 494.31 Min: 1 Median: 2.1504 Max: 35745 Percentiles: P50: 2.15 P75: 3.54 P99: 2605.45 P99.9: 4809.41 P99.99: 8212.31 ------------------------------------------------------ [ 0, 1 ] 3038 2.722% 2.722% # ( 1, 2 ] 48811 43.738% 46.461% ######### ( 2, 3 ] 26273 23.543% 70.003% ##### ( 3, 4 ] 10324 9.251% 79.254% ## ( 4, 6 ] 10376 9.298% 88.552% ## ( 6, 10 ] 2689 2.410% 90.961% ( 10, 15 ] 523 0.469% 91.430% ( 15, 22 ] 59 0.053% 91.483% ( 22, 34 ] 5 0.004% 91.487% ( 34, 51 ] 3 0.003% 91.490% ( 51, 76 ] 5 0.004% 91.494% ( 76, 110 ] 1 0.001% 91.495% ( 110, 170 ] 23 0.021% 91.516% ( 170, 250 ] 173 0.155% 91.671% ( 250, 380 ] 616 0.552% 92.223% ( 380, 580 ] 1562 1.400% 93.623% ( 580, 870 ] 2352 2.108% 95.730% ( 870, 1300 ] 2166 1.941% 97.671% ( 1300, 1900 ] 1017 0.911% 98.582% ( 1900, 2900 ] 662 0.593% 99.176% ( 2900, 4400 ] 788 0.706% 99.882% ( 4400, 6600 ] 115 0.103% 99.985% ( 6600, 9900 ] 14 0.013% 99.997% ( 9900, 14000 ] 4 0.004% 100.001% ( 14000, 22000 ] 3 0.003% 100.004% ( 22000, 33000 ] 3 0.003% 100.006% ( 33000, 50000 ] 1 0.001% 100.007% ** Level 1 read latency histogram (micros): Count: 131 Average: 1422.4962 StdDev: 1383.44 Min: 73 Median: 986.7143 Max: 6821 Percentiles: P50: 986.71 P75: 1571.88 P99: 6486.33 P99.9: 6821.00 P99.99: 6821.00 ------------------------------------------------------ ( 51, 76 ] 1 0.763% 0.763% ( 76, 110 ] 1 0.763% 1.527% ( 170, 250 ] 2 1.527% 3.053% ( 250, 380 ] 8 6.107% 9.160% # ( 380, 580 ] 20 15.267% 24.427% ### ( 580, 870 ] 24 18.321% 42.748% #### ( 870, 1300 ] 35 26.718% 69.466% ##### ( 1300, 1900 ] 16 12.214% 81.679% ## ( 1900, 2900 ] 6 4.580% 86.260% # ( 2900, 4400 ] 11 8.397% 94.656% ## ( 4400, 6600 ] 6 4.580% 99.237% # ( 6600, 9900 ] 1 0.763% 100.000% ** Level 2 read latency histogram (micros): Count: 481337 Average: 16.5338 StdDev: 220.99 Min: 1 Median: 2.1239 Max: 29697 Percentiles: P50: 2.12 P75: 3.13 P99: 10.17 P99.9: 858.74 P99.99: 1220.32 ------------------------------------------------------ [ 0, 1 ] 6737 1.400% 1.400% ( 1, 2 ] 217955 45.281% 46.681% ######### ( 2, 3 ] 128915 26.783% 73.463% ##### ( 3, 4 ] 55748 11.582% 85.045% ## ( 4, 6 ] 53806 11.178% 96.224% ## ( 6, 10 ] 13269 2.757% 98.981% # ( 10, 15 ] 2825 0.587% 99.567% ( 15, 22 ] 416 0.086% 99.654% ( 22, 34 ] 54 0.011% 99.665% ( 34, 51 ] 47 0.010% 99.675% ( 51, 76 ] 45 0.009% 99.684% ( 76, 110 ] 12 0.002% 99.687% ( 110, 170 ] 20 0.004% 99.691% ( 170, 250 ] 45 0.009% 99.700% ( 250, 380 ] 159 0.033% 99.733% ( 380, 580 ] 324 0.067% 99.801% ( 580, 870 ] 498 0.103% 99.904% ( 870, 1300 ] 508 0.106% 100.010% ( 1300, 1900 ] 373 0.077% 100.087% ( 1900, 2900 ] 557 0.116% 100.203% ( 2900, 4400 ] 628 0.130% 100.333% ( 4400, 6600 ] 138 0.029% 100.362% ( 6600, 9900 ] 37 0.008% 100.370% ( 9900, 14000 ] 7 0.001% 100.371% ( 14000, 22000 ] 8 0.002% 100.373% ( 22000, 33000 ] 2 0.000% 100.373% ** Level 3 read latency histogram (micros): Count: 527075 Average: 16.5168 StdDev: 198.03 Min: 1 Median: 2.1579 Max: 30542 Percentiles: P50: 2.16 P75: 3.15 P99: 13.02 P99.9: 1222.95 P99.99: 1606.84 ------------------------------------------------------ [ 0, 1 ] 5811 1.102% 1.102% ( 1, 2 ] 234734 44.535% 45.638% ######### ( 2, 3 ] 145587 27.622% 73.259% ###### ( 3, 4 ] 60479 11.474% 84.734% ## ( 4, 6 ] 58754 11.147% 95.881% ## ( 6, 10 ] 14936 2.834% 98.715% # ( 10, 15 ] 2488 0.472% 99.187% ( 15, 22 ] 311 0.059% 99.246% ( 22, 34 ] 74 0.014% 99.260% ( 34, 51 ] 89 0.017% 99.277% ( 51, 76 ] 47 0.009% 99.286% ( 76, 110 ] 30 0.006% 99.291% ( 110, 170 ] 39 0.007% 99.299% ( 170, 250 ] 99 0.019% 99.318% ( 250, 380 ] 313 0.059% 99.377% ( 380, 580 ] 767 0.146% 99.522% ( 580, 870 ] 1110 0.211% 99.733% ( 870, 1300 ] 1072 0.203% 99.936% ( 1300, 1900 ] 552 0.105% 100.041% ( 1900, 2900 ] 580 0.110% 100.151% ( 2900, 4400 ] 457 0.087% 100.238% ( 4400, 6600 ] 79 0.015% 100.253% ( 6600, 9900 ] 22 0.004% 100.257% ( 9900, 14000 ] 4 0.001% 100.258% ( 14000, 22000 ] 9 0.002% 100.260% ( 22000, 33000 ] 4 0.001% 100.260% ** Level 4 read latency histogram (micros): Count: 615387 Average: 26.5802 StdDev: 260.55 Min: 1 Median: 2.1522 Max: 45148 Percentiles: P50: 2.15 P75: 3.18 P99: 548.13 P99.9: 1611.46 P99.99: 1892.13 ------------------------------------------------------ [ 0, 1 ] 7774 1.263% 1.263% ( 1, 2 ] 274537 44.612% 45.875% ######### ( 2, 3 ] 166745 27.096% 72.971% ##### ( 3, 4 ] 70760 11.498% 84.470% ## ( 4, 6 ] 66975 10.883% 95.353% ## ( 6, 10 ] 16748 2.722% 98.075% # ( 10, 15 ] 2741 0.445% 98.520% ( 15, 22 ] 357 0.058% 98.578% ( 22, 34 ] 63 0.010% 98.588% ( 34, 51 ] 78 0.013% 98.601% ( 51, 76 ] 51 0.008% 98.609% ( 76, 110 ] 40 0.006% 98.616% ( 110, 170 ] 80 0.013% 98.629% ( 170, 250 ] 245 0.040% 98.669% ( 250, 380 ] 707 0.115% 98.784% ( 380, 580 ] 1587 0.258% 99.041% ( 580, 870 ] 2422 0.394% 99.435% ( 870, 1300 ] 2249 0.365% 99.800% ( 1300, 1900 ] 1184 0.192% 99.993% ( 1900, 2900 ] 985 0.160% 100.153% ( 2900, 4400 ] 1015 0.165% 100.318% ( 4400, 6600 ] 203 0.033% 100.351% ( 6600, 9900 ] 30 0.005% 100.356% ( 9900, 14000 ] 6 0.001% 100.357% ( 14000, 22000 ] 5 0.001% 100.357% ( 22000, 33000 ] 2 0.000% 100.358% ( 33000, 50000 ] 4 0.001% 100.358% ** Level 5 read latency histogram (micros): Count: 6236 Average: 1372.8376 StdDev: 1372.15 Min: 53 Median: 951.6456 Max: 52953 Percentiles: P50: 951.65 P75: 1703.14 P99: 5974.87 P99.9: 9685.33 P99.99: 52953.00 ------------------------------------------------------ ( 51, 76 ] 2 0.032% 0.032% ( 76, 110 ] 4 0.064% 0.096% ( 110, 170 ] 38 0.609% 0.706% ( 170, 250 ] 110 1.764% 2.470% ( 250, 380 ] 350 5.613% 8.082% # ( 380, 580 ] 927 14.865% 22.947% ### ( 580, 870 ] 1432 22.963% 45.911% ##### ( 870, 1300 ] 1343 21.536% 67.447% #### ( 1300, 1900 ] 701 11.241% 78.688% ## ( 1900, 2900 ] 565 9.060% 87.749% ## ( 2900, 4400 ] 605 9.702% 97.450% ## ( 4400, 6600 ] 135 2.165% 99.615% ( 6600, 9900 ] 19 0.305% 99.920% ( 9900, 14000 ] 2 0.032% 99.952% ( 14000, 22000 ] 2 0.032% 99.984% ( 50000, 75000 ] 1 0.016% 100.000% ** DB Stats ** Uptime(secs): 7.0 total, 6.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 140.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.977 H:M:S, 42.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 142.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.977 H:M:S, 43.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/10-12:18:39 ... thread 0: (1000000,2000000) ops and (184020.9,162157.1) ops/second in (5.434165,12.333722) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/9 2.29 GB 150.1 1.2 0.0 1.2 3.1 1.8 0.0 1.7 67.6 168.5 18.61 10.54 27 0.689 1276K 7508 0.0 0.0 L1 3/3 138.87 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 956.53 MB 1.0 2.7 2.5 0.2 2.7 2.4 0.0 1.1 111.3 109.2 25.13 13.25 8 3.141 1401K 0 0.0 0.0 L4 147/0 9.61 GB 1.0 8.4 2.8 5.6 7.2 1.6 0.6 2.6 153.1 130.8 56.37 35.69 31 1.818 1714K 0 0.0 0.0 L5 150/0 11.93 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 333/12 24.90 GB 0.0 12.4 5.3 7.1 12.9 5.9 3.3 7.0 126.7 132.4 100.11 59.48 66 1.517 4393K 7508 0.0 0.0 Int 0/0 0.00 KB 0.0 12.4 5.3 7.1 12.9 5.9 3.3 7.0 126.7 132.4 100.11 59.48 66 1.517 4393K 7508 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.4 5.3 7.1 11.1 4.0 0.0 0.0 143.2 128.4 88.55 54.12 43 2.059 4393K 7508 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 163.1 11.56 5.36 23 0.503 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.94 GB write, 1063.57 MB/s write, 12.39 GB read, 1017.93 MB/s read, 100.1 seconds Interval compaction: 12.94 GB write, 1074.22 MB/s write, 12.39 GB read, 1028.12 MB/s read, 100.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 36, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 458396 Average: 58.1733 StdDev: 412.65 Min: 1 Median: 1.9149 Max: 61853 Percentiles: P50: 1.91 P75: 2.96 P99: 1304.84 P99.9: 3893.57 P99.99: 4356.43 ------------------------------------------------------ [ 0, 1 ] 23956 5.226% 5.226% # ( 1, 2 ] 224344 48.941% 54.167% ########## ( 2, 3 ] 99679 21.745% 75.912% #### ( 3, 4 ] 36858 8.041% 83.953% ## ( 4, 6 ] 34783 7.588% 91.541% ## ( 6, 10 ] 8962 1.955% 93.496% ( 10, 15 ] 1451 0.317% 93.813% ( 15, 22 ] 194 0.042% 93.855% ( 22, 34 ] 26 0.006% 93.861% ( 34, 51 ] 19 0.004% 93.865% ( 51, 76 ] 41 0.009% 93.874% ( 76, 110 ] 255 0.056% 93.929% ( 110, 170 ] 1636 0.357% 94.286% ( 170, 250 ] 3916 0.854% 95.140% ( 250, 380 ] 4059 0.885% 96.026% ( 380, 580 ] 4482 0.978% 97.004% ( 580, 870 ] 4987 1.088% 98.092% ( 870, 1300 ] 4148 0.905% 98.997% ( 1300, 1900 ] 1990 0.434% 99.431% ( 1900, 2900 ] 1266 0.276% 99.707% ( 2900, 4400 ] 1337 0.292% 99.998% ( 4400, 6600 ] 186 0.041% 100.039% ( 6600, 9900 ] 23 0.005% 100.044% ( 9900, 14000 ] 10 0.002% 100.046% ( 14000, 22000 ] 14 0.003% 100.049% ( 22000, 33000 ] 14 0.003% 100.052% ( 33000, 50000 ] 8 0.002% 100.054% ( 50000, 75000 ] 2 0.000% 100.055% ** Level 1 read latency histogram (micros): Count: 23627 Average: 18.0425 StdDev: 167.94 Min: 1 Median: 3.2888 Max: 6821 Percentiles: P50: 3.29 P75: 4.89 P99: 366.78 P99.9: 2764.42 P99.99: 6100.34 ------------------------------------------------------ [ 0, 1 ] 190 0.804% 0.804% ( 1, 2 ] 6206 26.267% 27.071% ##### ( 2, 3 ] 4095 17.332% 44.403% ### ( 3, 4 ] 4579 19.380% 63.783% #### ( 4, 6 ] 5951 25.187% 88.970% ##### ( 6, 10 ] 1642 6.950% 95.920% # ( 10, 15 ] 326 1.380% 97.300% ( 15, 22 ] 179 0.758% 98.057% ( 22, 34 ] 18 0.076% 98.133% ( 34, 51 ] 1 0.004% 98.138% ( 51, 76 ] 2 0.008% 98.146% ( 76, 110 ] 5 0.021% 98.167% ( 110, 170 ] 24 0.102% 98.269% ( 170, 250 ] 82 0.347% 98.616% ( 250, 380 ] 101 0.427% 99.043% ( 380, 580 ] 71 0.301% 99.344% ( 580, 870 ] 45 0.190% 99.534% ( 870, 1300 ] 55 0.233% 99.767% ( 1300, 1900 ] 21 0.089% 99.856% ( 1900, 2900 ] 12 0.051% 99.907% ( 2900, 4400 ] 15 0.063% 99.970% ( 4400, 6600 ] 6 0.025% 99.996% ( 6600, 9900 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 481337 Average: 16.5338 StdDev: 220.99 Min: 1 Median: 2.1239 Max: 29697 Percentiles: P50: 2.12 P75: 3.13 P99: 10.17 P99.9: 858.74 P99.99: 1220.32 ------------------------------------------------------ [ 0, 1 ] 6737 1.400% 1.400% ( 1, 2 ] 217955 45.281% 46.681% ######### ( 2, 3 ] 128915 26.783% 73.463% ##### ( 3, 4 ] 55748 11.582% 85.045% ## ( 4, 6 ] 53806 11.178% 96.224% ## ( 6, 10 ] 13269 2.757% 98.981% # ( 10, 15 ] 2825 0.587% 99.567% ( 15, 22 ] 416 0.086% 99.654% ( 22, 34 ] 54 0.011% 99.665% ( 34, 51 ] 47 0.010% 99.675% ( 51, 76 ] 45 0.009% 99.684% ( 76, 110 ] 12 0.002% 99.687% ( 110, 170 ] 20 0.004% 99.691% ( 170, 250 ] 45 0.009% 99.700% ( 250, 380 ] 159 0.033% 99.733% ( 380, 580 ] 324 0.067% 99.801% ( 580, 870 ] 498 0.103% 99.904% ( 870, 1300 ] 508 0.106% 100.010% ( 1300, 1900 ] 373 0.077% 100.087% ( 1900, 2900 ] 557 0.116% 100.203% ( 2900, 4400 ] 628 0.130% 100.333% ( 4400, 6600 ] 138 0.029% 100.362% ( 6600, 9900 ] 37 0.008% 100.370% ( 9900, 14000 ] 7 0.001% 100.371% ( 14000, 22000 ] 8 0.002% 100.373% ( 22000, 33000 ] 2 0.000% 100.373% ** Level 3 read latency histogram (micros): Count: 726071 Average: 16.9564 StdDev: 199.01 Min: 1 Median: 2.1717 Max: 31946 Percentiles: P50: 2.17 P75: 3.18 P99: 21.36 P99.9: 1300.67 P99.99: 1769.10 ------------------------------------------------------ [ 0, 1 ] 8386 1.155% 1.155% ( 1, 2 ] 320243 44.106% 45.261% ######### ( 2, 3 ] 200429 27.605% 72.866% ###### ( 3, 4 ] 83977 11.566% 84.432% ## ( 4, 6 ] 81536 11.230% 95.662% ## ( 6, 10 ] 20517 2.826% 98.487% # ( 10, 15 ] 3336 0.459% 98.947% ( 15, 22 ] 425 0.059% 99.005% ( 22, 34 ] 85 0.012% 99.017% ( 34, 51 ] 106 0.015% 99.032% ( 51, 76 ] 61 0.008% 99.040% ( 76, 110 ] 43 0.006% 99.046% ( 110, 170 ] 250 0.034% 99.080% ( 170, 250 ] 600 0.083% 99.163% ( 250, 380 ] 819 0.113% 99.276% ( 380, 580 ] 1240 0.171% 99.447% ( 580, 870 ] 1683 0.232% 99.678% ( 870, 1300 ] 1608 0.221% 99.900% ( 1300, 1900 ] 837 0.115% 100.015% ( 1900, 2900 ] 720 0.099% 100.114% ( 2900, 4400 ] 582 0.080% 100.194% ( 4400, 6600 ] 98 0.013% 100.208% ( 6600, 9900 ] 30 0.004% 100.212% ( 9900, 14000 ] 5 0.001% 100.213% ( 14000, 22000 ] 12 0.002% 100.214% ( 22000, 33000 ] 6 0.001% 100.215% ** Level 4 read latency histogram (micros): Count: 1460769 Average: 22.7732 StdDev: 272.61 Min: 1 Median: 2.1681 Max: 54515 Percentiles: P50: 2.17 P75: 3.22 P99: 345.41 P99.9: 1212.65 P99.99: 1433.22 ------------------------------------------------------ [ 0, 1 ] 19031 1.303% 1.303% ( 1, 2 ] 645188 44.168% 45.471% ######### ( 2, 3 ] 393715 26.953% 72.423% ##### ( 3, 4 ] 172895 11.836% 84.259% ## ( 4, 6 ] 159998 10.953% 95.212% ## ( 6, 10 ] 39672 2.716% 97.928% # ( 10, 15 ] 6582 0.451% 98.378% ( 15, 22 ] 837 0.057% 98.436% ( 22, 34 ] 123 0.008% 98.444% ( 34, 51 ] 179 0.012% 98.456% ( 51, 76 ] 123 0.008% 98.465% ( 76, 110 ] 107 0.007% 98.472% ( 110, 170 ] 1493 0.102% 98.574% ( 170, 250 ] 3499 0.240% 98.814% ( 250, 380 ] 3706 0.254% 99.068% ( 380, 580 ] 4097 0.280% 99.348% ( 580, 870 ] 4778 0.327% 99.675% ( 870, 1300 ] 4124 0.282% 99.957% ( 1300, 1900 ] 2148 0.147% 100.104% ( 1900, 2900 ] 1714 0.117% 100.222% ( 2900, 4400 ] 1624 0.111% 100.333% ( 4400, 6600 ] 305 0.021% 100.354% ( 6600, 9900 ] 61 0.004% 100.358% ( 9900, 14000 ] 25 0.002% 100.360% ( 14000, 22000 ] 29 0.002% 100.362% ( 22000, 33000 ] 26 0.002% 100.364% ( 33000, 50000 ] 12 0.001% 100.364% ( 50000, 75000 ] 2 0.000% 100.364% ** Level 5 read latency histogram (micros): Count: 15629 Average: 943.0775 StdDev: 1467.43 Min: 53 Median: 569.3973 Max: 64032 Percentiles: P50: 569.40 P75: 1110.82 P99: 5142.63 P99.9: 16696.80 P99.99: 55463.75 ------------------------------------------------------ ( 51, 76 ] 2 0.013% 0.013% ( 76, 110 ] 31 0.198% 0.211% ( 110, 170 ] 997 6.379% 6.590% # ( 170, 250 ] 2344 14.998% 21.588% ### ( 250, 380 ] 2288 14.639% 36.228% ### ( 380, 580 ] 2273 14.543% 50.771% ### ( 580, 870 ] 2572 16.457% 67.228% ### ( 870, 1300 ] 2169 13.878% 81.106% ### ( 1300, 1900 ] 1102 7.051% 88.157% # ( 1900, 2900 ] 813 5.202% 93.359% # ( 2900, 4400 ] 825 5.279% 98.637% # ( 4400, 6600 ] 168 1.075% 99.712% ( 6600, 9900 ] 23 0.147% 99.859% ( 9900, 14000 ] 3 0.019% 99.878% ( 14000, 22000 ] 10 0.064% 99.942% ( 22000, 33000 ] 4 0.026% 99.968% ( 33000, 50000 ] 3 0.019% 99.987% ( 50000, 75000 ] 2 0.013% 100.000% ** DB Stats ** Uptime(secs): 12.5 total, 5.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 157.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.766 H:M:S, 38.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 181.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.789 H:M:S, 32.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/10-12:18:42 ... thread 0: (1000000,3000000) ops and (291129.5,190251.3) ops/second in (3.434897,15.768619) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.75 GB 256.4 2.3 0.0 2.3 5.1 2.7 0.0 1.8 68.9 150.2 34.66 17.79 46 0.754 2426K 13K 0.0 0.0 L1 8/0 596.58 MB 59.7 0.6 0.5 0.1 0.6 0.4 0.0 1.3 45.8 45.2 13.19 3.54 1 13.190 613K 7090 0.0 0.0 L3 17/0 956.53 MB 1.0 2.7 2.5 0.2 2.7 2.4 0.0 1.1 111.3 109.2 25.13 13.25 8 3.141 1401K 0 0.0 0.0 L4 147/0 9.61 GB 1.0 8.4 2.8 5.6 7.2 1.6 0.6 2.6 153.1 130.8 56.37 35.69 31 1.818 1714K 0 0.0 0.0 L5 150/0 11.93 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/4 25.81 GB 0.0 14.1 5.8 8.3 15.5 7.2 3.3 5.6 111.5 123.1 129.35 70.27 86 1.504 6155K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.1 5.8 8.3 15.5 7.2 3.3 5.6 111.5 123.1 129.35 70.27 86 1.504 6155K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.1 5.8 8.3 12.8 4.5 0.0 0.0 125.6 114.0 114.79 62.33 48 2.392 6155K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 194.3 14.56 7.94 38 0.383 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.8 interval Flush(GB): cumulative 2.763, interval 2.763 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.55 GB write, 1001.46 MB/s write, 14.08 GB read, 907.16 MB/s read, 129.4 seconds Interval compaction: 15.55 GB write, 1009.31 MB/s write, 14.08 GB read, 914.26 MB/s read, 129.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 36, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 772511 Average: 38.1024 StdDev: 320.11 Min: 1 Median: 1.7391 Max: 61853 Percentiles: P50: 1.74 P75: 2.61 P99: 957.34 P99.9: 3298.83 P99.99: 4078.85 ------------------------------------------------------ [ 0, 1 ] 79615 10.306% 10.306% ## ( 1, 2 ] 414895 53.707% 64.013% ########### ( 2, 3 ] 139042 17.999% 82.012% #### ( 3, 4 ] 46702 6.045% 88.058% # ( 4, 6 ] 42573 5.511% 93.569% # ( 6, 10 ] 11298 1.463% 95.031% ( 10, 15 ] 1730 0.224% 95.255% ( 15, 22 ] 239 0.031% 95.286% ( 22, 34 ] 40 0.005% 95.291% ( 34, 51 ] 21 0.003% 95.294% ( 51, 76 ] 49 0.006% 95.300% ( 76, 110 ] 373 0.048% 95.348% ( 110, 170 ] 3534 0.457% 95.806% ( 170, 250 ] 7357 0.952% 96.758% ( 250, 380 ] 6116 0.792% 97.550% ( 380, 580 ] 5193 0.672% 98.222% ( 580, 870 ] 5160 0.668% 98.890% ( 870, 1300 ] 4184 0.542% 99.432% ( 1300, 1900 ] 1995 0.258% 99.690% ( 1900, 2900 ] 1268 0.164% 99.854% ( 2900, 4400 ] 1337 0.173% 100.027% ( 4400, 6600 ] 186 0.024% 100.051% ( 6600, 9900 ] 23 0.003% 100.054% ( 9900, 14000 ] 10 0.001% 100.056% ( 14000, 22000 ] 14 0.002% 100.057% ( 22000, 33000 ] 14 0.002% 100.059% ( 33000, 50000 ] 8 0.001% 100.060% ( 50000, 75000 ] 2 0.000% 100.060% ** Level 1 read latency histogram (micros): Count: 36936 Average: 20.0276 StdDev: 142.54 Min: 1 Median: 3.6972 Max: 6821 Percentiles: P50: 3.70 P75: 5.23 P99: 364.03 P99.9: 1875.58 P99.99: 5612.35 ------------------------------------------------------ [ 0, 1 ] 193 0.523% 0.523% ( 1, 2 ] 6707 18.158% 18.681% #### ( 2, 3 ] 5396 14.609% 33.290% ### ( 3, 4 ] 8852 23.966% 57.256% ##### ( 4, 6 ] 10670 28.888% 86.144% ###### ( 6, 10 ] 2710 7.337% 93.481% # ( 10, 15 ] 594 1.608% 95.089% ( 15, 22 ] 321 0.869% 95.958% ( 22, 34 ] 27 0.073% 96.031% ( 34, 51 ] 2 0.005% 96.036% ( 51, 76 ] 5 0.014% 96.050% ( 76, 110 ] 25 0.068% 96.118% ( 110, 170 ] 295 0.799% 96.916% ( 170, 250 ] 510 1.381% 98.297% ( 250, 380 ] 296 0.801% 99.098% ( 380, 580 ] 145 0.393% 99.491% ( 580, 870 ] 65 0.176% 99.667% ( 870, 1300 ] 64 0.173% 99.840% ( 1300, 1900 ] 23 0.062% 99.903% ( 1900, 2900 ] 14 0.038% 99.940% ( 2900, 4400 ] 15 0.041% 99.981% ( 4400, 6600 ] 6 0.016% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 481337 Average: 16.5338 StdDev: 220.99 Min: 1 Median: 2.1239 Max: 29697 Percentiles: P50: 2.12 P75: 3.13 P99: 10.17 P99.9: 858.74 P99.99: 1220.32 ------------------------------------------------------ [ 0, 1 ] 6737 1.400% 1.400% ( 1, 2 ] 217955 45.281% 46.681% ######### ( 2, 3 ] 128915 26.783% 73.463% ##### ( 3, 4 ] 55748 11.582% 85.045% ## ( 4, 6 ] 53806 11.178% 96.224% ## ( 6, 10 ] 13269 2.757% 98.981% # ( 10, 15 ] 2825 0.587% 99.567% ( 15, 22 ] 416 0.086% 99.654% ( 22, 34 ] 54 0.011% 99.665% ( 34, 51 ] 47 0.010% 99.675% ( 51, 76 ] 45 0.009% 99.684% ( 76, 110 ] 12 0.002% 99.687% ( 110, 170 ] 20 0.004% 99.691% ( 170, 250 ] 45 0.009% 99.700% ( 250, 380 ] 159 0.033% 99.733% ( 380, 580 ] 324 0.067% 99.801% ( 580, 870 ] 498 0.103% 99.904% ( 870, 1300 ] 508 0.106% 100.010% ( 1300, 1900 ] 373 0.077% 100.087% ( 1900, 2900 ] 557 0.116% 100.203% ( 2900, 4400 ] 628 0.130% 100.333% ( 4400, 6600 ] 138 0.029% 100.362% ( 6600, 9900 ] 37 0.008% 100.370% ( 9900, 14000 ] 7 0.001% 100.371% ( 14000, 22000 ] 8 0.002% 100.373% ( 22000, 33000 ] 2 0.000% 100.373% ** Level 3 read latency histogram (micros): Count: 729242 Average: 17.9345 StdDev: 199.30 Min: 1 Median: 2.1796 Max: 31946 Percentiles: P50: 2.18 P75: 3.21 P99: 240.66 P99.9: 1299.94 P99.99: 1769.18 ------------------------------------------------------ [ 0, 1 ] 8386 1.150% 1.150% ( 1, 2 ] 320243 43.915% 45.064% ######### ( 2, 3 ] 200429 27.485% 72.549% ##### ( 3, 4 ] 83977 11.516% 84.065% ## ( 4, 6 ] 81536 11.181% 95.246% ## ( 6, 10 ] 20517 2.813% 98.059% # ( 10, 15 ] 3336 0.457% 98.517% ( 15, 22 ] 425 0.058% 98.575% ( 22, 34 ] 85 0.012% 98.586% ( 34, 51 ] 106 0.015% 98.601% ( 51, 76 ] 61 0.008% 98.609% ( 76, 110 ] 72 0.010% 98.619% ( 110, 170 ] 1065 0.146% 98.765% ( 170, 250 ] 1939 0.266% 99.031% ( 250, 380 ] 1511 0.207% 99.238% ( 380, 580 ] 1464 0.201% 99.439% ( 580, 870 ] 1737 0.238% 99.677% ( 870, 1300 ] 1625 0.223% 99.900% ( 1300, 1900 ] 839 0.115% 100.015% ( 1900, 2900 ] 720 0.099% 100.114% ( 2900, 4400 ] 582 0.080% 100.194% ( 4400, 6600 ] 98 0.013% 100.207% ( 6600, 9900 ] 30 0.004% 100.211% ( 9900, 14000 ] 5 0.001% 100.212% ( 14000, 22000 ] 12 0.002% 100.214% ( 22000, 33000 ] 6 0.001% 100.214% ** Level 4 read latency histogram (micros): Count: 1482699 Average: 25.9432 StdDev: 272.24 Min: 1 Median: 2.1959 Max: 54515 Percentiles: P50: 2.20 P75: 3.31 P99: 409.75 P99.9: 1213.42 P99.99: 1436.01 ------------------------------------------------------ [ 0, 1 ] 19031 1.284% 1.284% ( 1, 2 ] 645193 43.515% 44.798% ######### ( 2, 3 ] 393734 26.555% 71.354% ##### ( 3, 4 ] 173038 11.670% 83.024% ## ( 4, 6 ] 160205 10.805% 93.829% ## ( 6, 10 ] 39690 2.677% 96.506% # ( 10, 15 ] 6597 0.445% 96.951% ( 15, 22 ] 838 0.057% 97.007% ( 22, 34 ] 123 0.008% 97.016% ( 34, 51 ] 180 0.012% 97.028% ( 51, 76 ] 123 0.008% 97.036% ( 76, 110 ] 424 0.029% 97.065% ( 110, 170 ] 6911 0.466% 97.531% ( 170, 250 ] 12332 0.832% 98.362% ( 250, 380 ] 8601 0.580% 98.943% ( 380, 580 ] 5727 0.386% 99.329% ( 580, 870 ] 5115 0.345% 99.674% ( 870, 1300 ] 4200 0.283% 99.957% ( 1300, 1900 ] 2156 0.145% 100.102% ( 1900, 2900 ] 1720 0.116% 100.218% ( 2900, 4400 ] 1624 0.110% 100.328% ( 4400, 6600 ] 305 0.021% 100.349% ( 6600, 9900 ] 61 0.004% 100.353% ( 9900, 14000 ] 25 0.002% 100.354% ( 14000, 22000 ] 29 0.002% 100.356% ( 22000, 33000 ] 26 0.002% 100.358% ( 33000, 50000 ] 12 0.001% 100.359% ( 50000, 75000 ] 2 0.000% 100.359% ** Level 5 read latency histogram (micros): Count: 29942 Average: 607.5961 StdDev: 1119.68 Min: 53 Median: 294.1304 Max: 64032 Percentiles: P50: 294.13 P75: 630.78 P99: 4242.87 P99.9: 8760.50 P99.99: 44366.20 ------------------------------------------------------ ( 51, 76 ] 2 0.007% 0.007% ( 76, 110 ] 230 0.768% 0.775% ( 110, 170 ] 4598 15.356% 16.131% ### ( 170, 250 ] 8277 27.643% 43.775% ###### ( 250, 380 ] 5491 18.339% 62.113% #### ( 380, 580 ] 3368 11.248% 73.362% ## ( 580, 870 ] 2801 9.355% 82.717% ## ( 870, 1300 ] 2215 7.398% 90.114% # ( 1300, 1900 ] 1107 3.697% 93.811% # ( 1900, 2900 ] 815 2.722% 96.533% # ( 2900, 4400 ] 825 2.755% 99.289% # ( 4400, 6600 ] 168 0.561% 99.850% ( 6600, 9900 ] 23 0.077% 99.927% ( 9900, 14000 ] 3 0.010% 99.937% ( 14000, 22000 ] 10 0.033% 99.970% ( 22000, 33000 ] 4 0.013% 99.983% ( 33000, 50000 ] 3 0.010% 99.993% ( 50000, 75000 ] 2 0.007% 100.000% ** DB Stats ** Uptime(secs): 15.9 total, 3.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 185.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.826 H:M:S, 30.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.060 H:M:S, 1.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/10-12:18:45 ... thread 0: (1000000,4000000) ops and (290382.1,208199.3) ops/second in (3.443738,19.212357) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/4 3.73 GB 356.6 3.3 0.0 3.3 7.0 3.7 0.0 1.9 81.7 173.5 41.58 24.24 66 0.630 3448K 18K 0.0 0.0 L1 8/0 596.58 MB 59.7 0.6 0.5 0.1 0.6 0.4 0.0 1.3 45.8 45.2 13.19 3.54 1 13.190 613K 7090 0.0 0.0 L3 17/0 956.53 MB 1.0 2.7 2.5 0.2 2.7 2.4 0.0 1.1 111.3 109.2 25.13 13.25 8 3.141 1401K 0 0.0 0.0 L4 147/0 9.61 GB 1.0 8.4 2.8 5.6 7.2 1.6 0.6 2.6 153.1 130.8 56.37 35.69 31 1.818 1714K 0 0.0 0.0 L5 150/0 11.93 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 340/4 26.79 GB 0.0 15.1 5.8 9.3 17.5 8.2 3.3 4.7 113.2 131.6 136.27 76.72 106 1.286 7178K 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.1 5.8 9.3 17.5 8.2 3.3 4.7 113.2 131.6 136.27 76.72 106 1.286 7178K 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.1 5.8 9.3 13.8 4.5 0.0 0.0 130.0 118.7 118.67 66.11 52 2.282 7178K 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 217.9 17.60 10.61 54 0.326 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.3 total, 19.2 interval Flush(GB): cumulative 3.746, interval 3.746 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.51 GB write, 926.99 MB/s write, 15.07 GB read, 797.68 MB/s read, 136.3 seconds Interval compaction: 17.51 GB write, 932.95 MB/s write, 15.07 GB read, 802.80 MB/s read, 136.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 36, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1049663 Average: 30.3726 StdDev: 275.75 Min: 0 Median: 1.6620 Max: 61853 Percentiles: P50: 1.66 P75: 2.40 P99: 755.40 P99.9: 2843.66 P99.99: 3879.47 ------------------------------------------------------ [ 0, 1 ] 141023 13.435% 13.435% ### ( 1, 2 ] 579766 55.234% 68.669% ########### ( 2, 3 ] 165311 15.749% 84.418% ### ( 3, 4 ] 54717 5.213% 89.630% # ( 4, 6 ] 49172 4.685% 94.315% # ( 6, 10 ] 12333 1.175% 95.490% ( 10, 15 ] 2045 0.195% 95.685% ( 15, 22 ] 274 0.026% 95.711% ( 22, 34 ] 42 0.004% 95.715% ( 34, 51 ] 26 0.002% 95.717% ( 51, 76 ] 61 0.006% 95.723% ( 76, 110 ] 551 0.052% 95.776% ( 110, 170 ] 6242 0.595% 96.370% ( 170, 250 ] 11086 1.056% 97.426% ( 250, 380 ] 7817 0.745% 98.171% ( 380, 580 ] 5552 0.529% 98.700% ( 580, 870 ] 5207 0.496% 99.196% ( 870, 1300 ] 4189 0.399% 99.595% ( 1300, 1900 ] 2000 0.191% 99.786% ( 1900, 2900 ] 1272 0.121% 99.907% ( 2900, 4400 ] 1337 0.127% 100.034% ( 4400, 6600 ] 186 0.018% 100.052% ( 6600, 9900 ] 23 0.002% 100.054% ( 9900, 14000 ] 10 0.001% 100.055% ( 14000, 22000 ] 14 0.001% 100.056% ( 22000, 33000 ] 14 0.001% 100.058% ( 33000, 50000 ] 8 0.001% 100.059% ( 50000, 75000 ] 2 0.000% 100.059% ** Level 1 read latency histogram (micros): Count: 38545 Average: 27.8549 StdDev: 145.53 Min: 1 Median: 3.7871 Max: 6821 Percentiles: P50: 3.79 P75: 5.45 P99: 394.26 P99.9: 1833.61 P99.99: 5553.35 ------------------------------------------------------ [ 0, 1 ] 193 0.501% 0.501% ( 1, 2 ] 6707 17.400% 17.901% ### ( 2, 3 ] 5396 13.999% 31.900% ### ( 3, 4 ] 8864 22.996% 54.897% ##### ( 4, 6 ] 10685 27.721% 82.618% ###### ( 6, 10 ] 2712 7.036% 89.654% # ( 10, 15 ] 595 1.544% 91.197% ( 15, 22 ] 321 0.833% 92.030% ( 22, 34 ] 27 0.070% 92.100% ( 34, 51 ] 2 0.005% 92.105% ( 51, 76 ] 6 0.016% 92.121% ( 76, 110 ] 64 0.166% 92.287% ( 110, 170 ] 804 2.086% 94.373% ( 170, 250 ] 1194 3.098% 97.470% # ( 250, 380 ] 575 1.492% 98.962% ( 380, 580 ] 204 0.529% 99.492% ( 580, 870 ] 73 0.189% 99.681% ( 870, 1300 ] 64 0.166% 99.847% ( 1300, 1900 ] 23 0.060% 99.907% ( 1900, 2900 ] 14 0.036% 99.943% ( 2900, 4400 ] 15 0.039% 99.982% ( 4400, 6600 ] 6 0.016% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 481337 Average: 16.5338 StdDev: 220.99 Min: 1 Median: 2.1239 Max: 29697 Percentiles: P50: 2.12 P75: 3.13 P99: 10.17 P99.9: 858.74 P99.99: 1220.32 ------------------------------------------------------ [ 0, 1 ] 6737 1.400% 1.400% ( 1, 2 ] 217955 45.281% 46.681% ######### ( 2, 3 ] 128915 26.783% 73.463% ##### ( 3, 4 ] 55748 11.582% 85.045% ## ( 4, 6 ] 53806 11.178% 96.224% ## ( 6, 10 ] 13269 2.757% 98.981% # ( 10, 15 ] 2825 0.587% 99.567% ( 15, 22 ] 416 0.086% 99.654% ( 22, 34 ] 54 0.011% 99.665% ( 34, 51 ] 47 0.010% 99.675% ( 51, 76 ] 45 0.009% 99.684% ( 76, 110 ] 12 0.002% 99.687% ( 110, 170 ] 20 0.004% 99.691% ( 170, 250 ] 45 0.009% 99.700% ( 250, 380 ] 159 0.033% 99.733% ( 380, 580 ] 324 0.067% 99.801% ( 580, 870 ] 498 0.103% 99.904% ( 870, 1300 ] 508 0.106% 100.010% ( 1300, 1900 ] 373 0.077% 100.087% ( 1900, 2900 ] 557 0.116% 100.203% ( 2900, 4400 ] 628 0.130% 100.333% ( 4400, 6600 ] 138 0.029% 100.362% ( 6600, 9900 ] 37 0.008% 100.370% ( 9900, 14000 ] 7 0.001% 100.371% ( 14000, 22000 ] 8 0.002% 100.373% ( 22000, 33000 ] 2 0.000% 100.373% ** Level 3 read latency histogram (micros): Count: 732574 Average: 18.8602 StdDev: 199.52 Min: 1 Median: 2.1879 Max: 31946 Percentiles: P50: 2.19 P75: 3.24 P99: 283.39 P99.9: 1303.15 P99.99: 1772.98 ------------------------------------------------------ [ 0, 1 ] 8386 1.145% 1.145% ( 1, 2 ] 320243 43.715% 44.859% ######### ( 2, 3 ] 200429 27.360% 72.219% ##### ( 3, 4 ] 83977 11.463% 83.682% ## ( 4, 6 ] 81536 11.130% 94.812% ## ( 6, 10 ] 20517 2.801% 97.613% # ( 10, 15 ] 3336 0.455% 98.068% ( 15, 22 ] 425 0.058% 98.126% ( 22, 34 ] 85 0.012% 98.138% ( 34, 51 ] 106 0.014% 98.153% ( 51, 76 ] 61 0.008% 98.161% ( 76, 110 ] 132 0.018% 98.179% ( 110, 170 ] 2077 0.284% 98.462% ( 170, 250 ] 3383 0.462% 98.924% ( 250, 380 ] 2162 0.295% 99.219% ( 380, 580 ] 1607 0.219% 99.439% ( 580, 870 ] 1750 0.239% 99.678% ( 870, 1300 ] 1625 0.222% 99.899% ( 1300, 1900 ] 842 0.115% 100.014% ( 1900, 2900 ] 724 0.099% 100.113% ( 2900, 4400 ] 583 0.080% 100.193% ( 4400, 6600 ] 98 0.013% 100.206% ( 6600, 9900 ] 30 0.004% 100.210% ( 9900, 14000 ] 5 0.001% 100.211% ( 14000, 22000 ] 12 0.002% 100.213% ( 22000, 33000 ] 6 0.001% 100.213% ** Level 4 read latency histogram (micros): Count: 1505257 Average: 28.8165 StdDev: 271.45 Min: 1 Median: 2.2245 Max: 54515 Percentiles: P50: 2.22 P75: 3.41 P99: 431.50 P99.9: 1212.95 P99.99: 1438.98 ------------------------------------------------------ [ 0, 1 ] 19031 1.264% 1.264% ( 1, 2 ] 645193 42.863% 44.127% ######### ( 2, 3 ] 393734 26.157% 70.284% ##### ( 3, 4 ] 173038 11.496% 81.780% ## ( 4, 6 ] 160205 10.643% 92.423% ## ( 6, 10 ] 39690 2.637% 95.060% # ( 10, 15 ] 6597 0.438% 95.498% ( 15, 22 ] 838 0.056% 95.554% ( 22, 34 ] 123 0.008% 95.562% ( 34, 51 ] 180 0.012% 95.574% ( 51, 76 ] 123 0.008% 95.582% ( 76, 110 ] 803 0.053% 95.635% ( 110, 170 ] 13768 0.915% 96.550% ( 170, 250 ] 22273 1.480% 98.030% ( 250, 380 ] 12882 0.856% 98.885% ( 380, 580 ] 6705 0.445% 99.331% ( 580, 870 ] 5207 0.346% 99.677% ( 870, 1300 ] 4215 0.280% 99.957% ( 1300, 1900 ] 2165 0.144% 100.101% ( 1900, 2900 ] 1724 0.115% 100.215% ( 2900, 4400 ] 1626 0.108% 100.323% ( 4400, 6600 ] 305 0.020% 100.343% ( 6600, 9900 ] 61 0.004% 100.347% ( 9900, 14000 ] 25 0.002% 100.349% ( 14000, 22000 ] 29 0.002% 100.351% ( 22000, 33000 ] 26 0.002% 100.353% ( 33000, 50000 ] 12 0.001% 100.353% ( 50000, 75000 ] 2 0.000% 100.354% ** Level 5 read latency histogram (micros): Count: 45036 Average: 476.8071 StdDev: 933.11 Min: 53 Median: 239.1132 Max: 64032 Percentiles: P50: 239.11 P75: 419.70 P99: 3968.96 P99.9: 6599.53 P99.99: 35812.93 ------------------------------------------------------ ( 51, 76 ] 2 0.004% 0.004% ( 76, 110 ] 533 1.183% 1.188% ( 110, 170 ] 9172 20.366% 21.554% #### ( 170, 250 ] 14829 32.927% 54.481% ####### ( 250, 380 ] 8446 18.754% 73.235% #### ( 380, 580 ] 4005 8.893% 82.128% ## ( 580, 870 ] 2860 6.350% 88.478% # ( 870, 1300 ] 2219 4.927% 93.405% # ( 1300, 1900 ] 1110 2.465% 95.870% ( 1900, 2900 ] 821 1.823% 97.693% ( 2900, 4400 ] 826 1.834% 99.527% ( 4400, 6600 ] 168 0.373% 99.900% ( 6600, 9900 ] 23 0.051% 99.951% ( 9900, 14000 ] 3 0.007% 99.958% ( 14000, 22000 ] 10 0.022% 99.980% ( 22000, 33000 ] 4 0.009% 99.989% ( 33000, 50000 ] 3 0.007% 99.996% ( 50000, 75000 ] 2 0.004% 100.000% ** DB Stats ** Uptime(secs): 19.3 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 203.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.952 H:M:S, 25.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 285.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.126 H:M:S, 3.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 519.166 micros/op 7655 ops/sec 20.247 seconds 154996 operations; 7.4 MB/s (37999 of 37999 found) Microseconds per read: Count: 154996 Average: 519.1846 StdDev: 1262.62 Min: 2 Median: 291.5613 Max: 75242 Percentiles: P50: 291.56 P75: 469.98 P99: 4125.12 P99.9: 19722.86 P99.99: 47166.99 ------------------------------------------------------ ( 1, 2 ] 1 0.001% 0.001% ( 2, 3 ] 4 0.003% 0.003% ( 3, 4 ] 18 0.012% 0.015% ( 4, 6 ] 107 0.069% 0.084% ( 6, 10 ] 297 0.192% 0.275% ( 10, 15 ] 341 0.220% 0.495% ( 15, 22 ] 478 0.308% 0.804% ( 22, 34 ] 4098 2.644% 3.448% # ( 34, 51 ] 3392 2.188% 5.636% ( 51, 76 ] 519 0.335% 5.971% ( 76, 110 ] 36 0.023% 5.994% ( 110, 170 ] 6051 3.904% 9.898% # ( 170, 250 ] 48310 31.169% 41.067% ###### ( 250, 380 ] 43309 27.942% 69.009% ###### ( 380, 580 ] 20639 13.316% 82.325% ### ( 580, 870 ] 10770 6.949% 89.273% # ( 870, 1300 ] 7023 4.531% 93.804% # ( 1300, 1900 ] 3612 2.330% 96.135% ( 1900, 2900 ] 2547 1.643% 97.778% ( 2900, 4400 ] 2319 1.496% 99.274% ( 4400, 6600 ] 608 0.392% 99.666% ( 6600, 9900 ] 203 0.131% 99.797% ( 9900, 14000 ] 61 0.039% 99.837% ( 14000, 22000 ] 137 0.088% 99.925% ( 22000, 33000 ] 83 0.054% 99.979% ( 33000, 50000 ] 21 0.014% 99.992% ( 50000, 75000 ] 11 0.007% 99.999% ( 75000, 110000 ] 1 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2427424 rocksdb.bloom.filter.full.positive COUNT : 177797 rocksdb.bloom.filter.full.true.positive COUNT : 154187 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 809 rocksdb.memtable.miss COUNT : 154187 rocksdb.l0.hit COUNT : 19124 rocksdb.l1.hit COUNT : 2898 rocksdb.l2andup.hit COUNT : 132165 rocksdb.compaction.key.drop.new COUNT : 1358408 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4252786 rocksdb.number.keys.read COUNT : 154996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4388875152 rocksdb.bytes.read COUNT : 154996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 541 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5112841 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16451505147 rocksdb.compact.write.bytes COUNT : 15049806125 rocksdb.flush.write.bytes COUNT : 4286493156 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 37 rocksdb.number.superversion_acquires COUNT : 755 rocksdb.number.superversion_releases COUNT : 728 rocksdb.number.superversion_cleanups COUNT : 189 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 200 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4259128320 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8269824 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16352836352 rocksdb.non.last.level.read.count COUNT : 3921391 rocksdb.block.checksum.compute.count COUNT : 4165445 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 289.640192 P95 : 1606.271139 P99 : 4124.647948 P100 : 75241.000000 COUNT : 154996 SUM : 80270987 rocksdb.db.write.micros P50 : 1.506534 P95 : 3.872707 P99 : 5.794384 P100 : 807234.000000 COUNT : 4252786 SUM : 15188136 rocksdb.compaction.times.micros P50 : 1802777.777778 P95 : 5070000.000000 P99 : 12887000.000000 P100 : 13190081.000000 COUNT : 53 SUM : 119616220 rocksdb.compaction.times.cpu_micros P50 : 1152400.000000 P95 : 1878333.333333 P99 : 3539652.000000 P100 : 3539652.000000 COUNT : 53 SUM : 67039892 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 913.000000 P95 : 76750.000000 P99 : 133246.000000 P100 : 133246.000000 COUNT : 58 SUM : 524904 rocksdb.compaction.outfile.sync.micros P50 : 8910.000000 P95 : 66428.571429 P99 : 104866.666667 P100 : 114391.000000 COUNT : 188 SUM : 3312296 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 214.444444 P95 : 2460.000000 P99 : 3935.000000 P100 : 4296.000000 COUNT : 124 SUM : 70137 rocksdb.table.open.io.micros P50 : 6710.000000 P95 : 19754.666667 P99 : 23081.666667 P100 : 27397.000000 COUNT : 541 SUM : 4029414 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.135048 P95 : 9.395174 P99 : 89.033333 P100 : 61857.000000 COUNT : 3984695 SUM : 65385032 rocksdb.read.block.get.micros P50 : 224.868230 P95 : 1325.621622 P99 : 3712.984481 P100 : 64037.000000 COUNT : 180198 SUM : 72218356 rocksdb.write.raw.block.micros P50 : 0.528452 P95 : 1.109863 P99 : 3.930255 P100 : 64825.000000 COUNT : 4691798 SUM : 15667206 rocksdb.numfiles.in.singlecompaction P50 : 3.351064 P95 : 3.992553 P99 : 25.000000 P100 : 25.000000 COUNT : 67 SUM : 269 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561987 P95 : 1111.786052 P99 : 1284.314657 P100 : 807072.000000 COUNT : 4243 SUM : 5113329 rocksdb.sst.read.micros P50 : 1.992694 P95 : 112.421078 P99 : 712.921523 P100 : 64032.000000 COUNT : 3921428 SUM : 123459917 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 154996 SUM : 154996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4252786 SUM : 4388875152 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 229487.179487 P95 : 816500.000000 P99 : 1033080.000000 P100 : 1033080.000000 COUNT : 58 SUM : 18361345 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 200 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0