[2024-12-10 17:36:04.971558] Starting SPDK v25.01-pre git sha1 1a5bdab32 / DPDK 24.03.0 initialization... [2024-12-10 17:36:04.971867] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2300574 ] Set seed to 1733848564964284 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-10 17:36:05.125104] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-10 17:36:05.227971] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-10 17:36:05.228023] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2300574' to capture a snapshot of events at runtime. [2024-12-10 17:36:05.228037] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-10 17:36:05.228050] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-10 17:36:05.228060] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2300574 for offline analysis/debug. [2024-12-10 17:36:05.229320] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 10 17:36:08 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/10-17:36:15 ... thread 0: (1000000,1000000) ops and (142424.6,142424.6) ops/second in (7.021260,7.021260) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.32 GB 56.4 0.3 0.0 0.3 1.2 0.9 0.0 1.4 35.3 133.9 8.90 4.24 12 0.742 319K 1850 0.0 0.0 L1 4/4 253.58 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 29/8 1.45 GB 1.0 2.2 1.6 0.6 2.2 1.6 0.0 1.3 104.4 102.4 21.88 11.99 10 2.188 1628K 7543 0.0 0.0 L4 153/29 10.87 GB 0.9 2.7 1.6 1.1 2.6 1.5 0.3 1.6 109.9 105.6 25.40 14.61 13 1.953 636K 0 0.0 0.0 L5 136/0 10.46 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 335/50 24.34 GB 0.0 5.3 3.3 2.0 6.0 4.0 1.6 6.9 95.9 108.9 56.18 30.84 35 1.605 2583K 9393 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 3.3 2.0 6.0 4.0 1.6 6.9 95.9 108.9 56.18 30.84 35 1.605 2583K 9393 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 3.3 2.0 5.1 3.1 0.0 0.0 108.2 105.1 49.81 28.17 24 2.075 2583K 9393 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 138.1 6.37 2.67 11 0.579 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.1 total, 7.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.97 GB write, 860.30 MB/s write, 5.26 GB read, 758.21 MB/s read, 56.2 seconds Interval compaction: 5.97 GB write, 870.79 MB/s write, 5.26 GB read, 767.46 MB/s read, 56.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 198759 Average: 44.6195 StdDev: 428.25 Min: 1 Median: 2.2319 Max: 50577 Percentiles: P50: 2.23 P75: 3.28 P99: 1053.30 P99.9: 4342.22 P99.99: 7847.74 ------------------------------------------------------ [ 0, 1 ] 3536 1.779% 1.779% ( 1, 2 ] 82463 41.489% 43.268% ######## ( 2, 3 ] 57693 29.027% 72.295% ###### ( 3, 4 ] 18939 9.529% 81.823% ## ( 4, 6 ] 21998 11.068% 92.891% ## ( 6, 10 ] 6037 3.037% 95.928% # ( 10, 15 ] 1259 0.633% 96.562% ( 15, 22 ] 176 0.089% 96.650% ( 22, 34 ] 29 0.015% 96.665% ( 34, 51 ] 36 0.018% 96.683% ( 51, 76 ] 42 0.021% 96.704% ( 76, 110 ] 10 0.005% 96.709% ( 110, 170 ] 52 0.026% 96.735% ( 170, 250 ] 222 0.112% 96.847% ( 250, 380 ] 708 0.356% 97.203% ( 380, 580 ] 1482 0.746% 97.949% ( 580, 870 ] 1661 0.836% 98.784% ( 870, 1300 ] 1005 0.506% 99.290% ( 1300, 1900 ] 357 0.180% 99.470% ( 1900, 2900 ] 387 0.195% 99.664% ( 2900, 4400 ] 487 0.245% 99.909% ( 4400, 6600 ] 145 0.073% 99.982% ( 6600, 9900 ] 40 0.020% 100.003% ( 9900, 14000 ] 8 0.004% 100.007% ( 14000, 22000 ] 19 0.010% 100.016% ( 22000, 33000 ] 9 0.005% 100.021% ( 33000, 50000 ] 2 0.001% 100.022% ( 50000, 75000 ] 1 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 25441 Average: 27.2471 StdDev: 467.42 Min: 1 Median: 2.4686 Max: 32270 Percentiles: P50: 2.47 P75: 3.62 P99: 499.14 P99.9: 4372.44 P99.99: 23671.63 ------------------------------------------------------ [ 0, 1 ] 163 0.641% 0.641% ( 1, 2 ] 8569 33.682% 34.323% ####### ( 2, 3 ] 8512 33.458% 67.780% ####### ( 3, 4 ] 2966 11.658% 79.439% ## ( 4, 6 ] 3638 14.300% 93.738% ### ( 6, 10 ] 975 3.832% 97.571% # ( 10, 15 ] 196 0.770% 98.341% ( 15, 22 ] 28 0.110% 98.451% ( 22, 34 ] 7 0.028% 98.479% ( 34, 51 ] 12 0.047% 98.526% ( 51, 76 ] 7 0.028% 98.554% ( 76, 110 ] 2 0.008% 98.561% ( 110, 170 ] 6 0.024% 98.585% ( 170, 250 ] 14 0.055% 98.640% ( 250, 380 ] 35 0.138% 98.778% ( 380, 580 ] 95 0.373% 99.151% ( 580, 870 ] 92 0.362% 99.513% ( 870, 1300 ] 42 0.165% 99.678% ( 1300, 1900 ] 18 0.071% 99.748% ( 1900, 2900 ] 15 0.059% 99.807% ( 2900, 4400 ] 24 0.094% 99.902% ( 4400, 6600 ] 8 0.031% 99.933% ( 6600, 9900 ] 7 0.028% 99.961% ( 9900, 14000 ] 3 0.012% 99.972% ( 14000, 22000 ] 4 0.016% 99.988% ( 22000, 33000 ] 3 0.012% 100.000% ** Level 2 read latency histogram (micros): Count: 329004 Average: 16.9847 StdDev: 290.46 Min: 1 Median: 2.3282 Max: 38978 Percentiles: P50: 2.33 P75: 3.38 P99: 14.14 P99.9: 2122.21 P99.99: 3381.55 ------------------------------------------------------ [ 0, 1 ] 3109 0.945% 0.945% ( 1, 2 ] 127988 38.902% 39.847% ######## ( 2, 3 ] 101775 30.934% 70.781% ###### ( 3, 4 ] 36106 10.974% 81.755% ## ( 4, 6 ] 43439 13.203% 94.958% ### ( 6, 10 ] 10867 3.303% 98.261% # ( 10, 15 ] 2932 0.891% 99.153% ( 15, 22 ] 486 0.148% 99.300% ( 22, 34 ] 67 0.020% 99.321% ( 34, 51 ] 117 0.036% 99.356% ( 51, 76 ] 108 0.033% 99.389% ( 76, 110 ] 50 0.015% 99.404% ( 110, 170 ] 39 0.012% 99.416% ( 170, 250 ] 78 0.024% 99.440% ( 250, 380 ] 303 0.092% 99.532% ( 380, 580 ] 453 0.138% 99.670% ( 580, 870 ] 358 0.109% 99.778% ( 870, 1300 ] 195 0.059% 99.838% ( 1300, 1900 ] 147 0.045% 99.882% ( 1900, 2900 ] 261 0.079% 99.962% ( 2900, 4400 ] 290 0.088% 100.050% ( 4400, 6600 ] 130 0.040% 100.089% ( 6600, 9900 ] 53 0.016% 100.105% ( 9900, 14000 ] 25 0.008% 100.113% ( 14000, 22000 ] 15 0.005% 100.118% ( 22000, 33000 ] 5 0.002% 100.119% ( 33000, 50000 ] 2 0.001% 100.120% ** Level 3 read latency histogram (micros): Count: 477220 Average: 18.2466 StdDev: 329.43 Min: 1 Median: 2.3575 Max: 57414 Percentiles: P50: 2.36 P75: 3.37 P99: 14.66 P99.9: 1425.17 P99.99: 2538.66 ------------------------------------------------------ [ 0, 1 ] 3535 0.741% 0.741% ( 1, 2 ] 179510 37.616% 38.357% ######## ( 2, 3 ] 155411 32.566% 70.922% ####### ( 3, 4 ] 53072 11.121% 82.044% ## ( 4, 6 ] 62275 13.050% 95.093% ### ( 6, 10 ] 15474 3.243% 98.336% # ( 10, 15 ] 3404 0.713% 99.049% ( 15, 22 ] 456 0.096% 99.144% ( 22, 34 ] 93 0.019% 99.164% ( 34, 51 ] 177 0.037% 99.201% ( 51, 76 ] 134 0.028% 99.229% ( 76, 110 ] 45 0.009% 99.239% ( 110, 170 ] 67 0.014% 99.253% ( 170, 250 ] 188 0.039% 99.292% ( 250, 380 ] 546 0.114% 99.406% ( 380, 580 ] 966 0.202% 99.609% ( 580, 870 ] 861 0.180% 99.789% ( 870, 1300 ] 477 0.100% 99.889% ( 1300, 1900 ] 253 0.053% 99.942% ( 1900, 2900 ] 359 0.075% 100.017% ( 2900, 4400 ] 433 0.091% 100.108% ( 4400, 6600 ] 122 0.026% 100.134% ( 6600, 9900 ] 53 0.011% 100.145% ( 9900, 14000 ] 21 0.004% 100.149% ( 14000, 22000 ] 34 0.007% 100.156% ( 22000, 33000 ] 16 0.003% 100.160% ( 33000, 50000 ] 6 0.001% 100.161% ( 50000, 75000 ] 1 0.000% 100.161% ** Level 4 read latency histogram (micros): Count: 571798 Average: 32.9567 StdDev: 416.34 Min: 0 Median: 2.3825 Max: 55975 Percentiles: P50: 2.38 P75: 3.51 P99: 604.10 P99.9: 2320.75 P99.99: 3015.24 ------------------------------------------------------ [ 0, 1 ] 5278 0.923% 0.923% ( 1, 2 ] 212721 37.202% 38.125% ####### ( 2, 3 ] 177526 31.047% 69.172% ###### ( 3, 4 ] 65567 11.467% 80.639% ## ( 4, 6 ] 75941 13.281% 93.920% ### ( 6, 10 ] 18713 3.273% 97.193% # ( 10, 15 ] 4178 0.731% 97.923% ( 15, 22 ] 564 0.099% 98.022% ( 22, 34 ] 89 0.016% 98.038% ( 34, 51 ] 156 0.027% 98.065% ( 51, 76 ] 133 0.023% 98.088% ( 76, 110 ] 32 0.006% 98.094% ( 110, 170 ] 122 0.021% 98.115% ( 170, 250 ] 476 0.083% 98.198% ( 250, 380 ] 1563 0.273% 98.472% ( 380, 580 ] 2794 0.489% 98.960% ( 580, 870 ] 2829 0.495% 99.455% ( 870, 1300 ] 1574 0.275% 99.730% ( 1300, 1900 ] 667 0.117% 99.847% ( 1900, 2900 ] 742 0.130% 99.977% ( 2900, 4400 ] 1104 0.193% 100.170% ( 4400, 6600 ] 321 0.056% 100.226% ( 6600, 9900 ] 87 0.015% 100.241% ( 9900, 14000 ] 17 0.003% 100.244% ( 14000, 22000 ] 44 0.008% 100.252% ( 22000, 33000 ] 37 0.006% 100.258% ( 33000, 50000 ] 10 0.002% 100.260% ( 50000, 75000 ] 2 0.000% 100.260% ** Level 5 read latency histogram (micros): Count: 7437 Average: 1206.6036 StdDev: 2050.09 Min: 94 Median: 670.7113 Max: 49091 Percentiles: P50: 670.71 P75: 1203.01 P99: 6461.65 P99.9: 32599.42 P99.99: 48193.87 ------------------------------------------------------ ( 76, 110 ] 3 0.040% 0.040% ( 110, 170 ] 67 0.901% 0.941% ( 170, 250 ] 328 4.410% 5.352% # ( 250, 380 ] 1052 14.145% 19.497% ### ( 380, 580 ] 1743 23.437% 42.934% ##### ( 580, 870 ] 1680 22.590% 65.524% ##### ( 870, 1300 ] 910 12.236% 77.760% ## ( 1300, 1900 ] 413 5.553% 83.313% # ( 1900, 2900 ] 414 5.567% 88.880% # ( 2900, 4400 ] 613 8.243% 97.122% ## ( 4400, 6600 ] 149 2.003% 99.126% ( 6600, 9900 ] 30 0.403% 99.529% ( 9900, 14000 ] 6 0.081% 99.610% ( 14000, 22000 ] 10 0.134% 99.745% ( 22000, 33000 ] 12 0.161% 99.906% ( 33000, 50000 ] 7 0.094% 100.000% ** DB Stats ** Uptime(secs): 7.1 total, 7.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 138.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.187 H:M:S, 30.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 140.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.187 H:M:S, 31.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/10-17:36:19 ... thread 0: (1000000,2000000) ops and (225596.1,174612.1) ops/second in (4.432700,11.453960) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 1.84 GB 131.4 1.2 0.0 1.2 3.0 1.8 0.0 1.6 70.0 180.2 17.07 10.74 30 0.569 1213K 6691 0.0 0.0 L1 8/0 713.22 MB 71.3 0.7 0.5 0.2 0.7 0.4 0.0 1.5 69.3 68.3 10.44 4.27 1 10.436 734K 9844 0.0 0.0 L3 20/0 949.69 MB 0.9 2.2 1.6 0.6 2.2 1.6 0.0 1.3 104.4 102.4 21.88 11.99 10 2.188 1628K 7543 0.0 0.0 L4 142/0 9.57 GB 1.0 5.8 2.1 3.7 5.2 1.5 0.3 2.4 126.9 113.2 47.05 29.41 22 2.139 1177K 0 0.0 0.0 L5 156/0 11.75 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 340/8 24.78 GB 0.0 9.9 4.2 5.7 11.1 5.4 2.9 6.0 105.5 117.8 96.44 56.42 63 1.531 4753K 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.9 4.2 5.7 11.1 5.4 2.9 6.0 105.5 117.8 96.44 56.42 63 1.531 4753K 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.9 4.2 5.7 9.2 3.6 0.0 0.0 118.2 110.0 86.07 50.82 37 2.326 4753K 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 182.0 10.37 5.60 26 0.399 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.5 total, 11.5 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.09 GB write, 983.98 MB/s write, 9.93 GB read, 881.32 MB/s read, 96.4 seconds Interval compaction: 11.09 GB write, 991.34 MB/s write, 9.93 GB read, 887.91 MB/s read, 96.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 25, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 491233 Average: 38.4812 StdDev: 354.94 Min: 1 Median: 1.8562 Max: 53529 Percentiles: P50: 1.86 P75: 2.86 P99: 723.54 P99.9: 3298.37 P99.99: 4329.73 ------------------------------------------------------ [ 0, 1 ] 40394 8.223% 8.223% ## ( 1, 2 ] 239700 48.796% 57.019% ########## ( 2, 3 ] 103140 20.996% 78.015% #### ( 3, 4 ] 32092 6.533% 84.548% # ( 4, 6 ] 32873 6.692% 91.240% # ( 6, 10 ] 9544 1.943% 93.182% ( 10, 15 ] 1869 0.380% 93.563% ( 15, 22 ] 243 0.049% 93.612% ( 22, 34 ] 44 0.009% 93.621% ( 34, 51 ] 45 0.009% 93.631% ( 51, 76 ] 44 0.009% 93.639% ( 76, 110 ] 134 0.027% 93.667% ( 110, 170 ] 3885 0.791% 94.458% ( 170, 250 ] 10865 2.212% 96.669% ( 250, 380 ] 5501 1.120% 97.789% ( 380, 580 ] 4393 0.894% 98.684% ( 580, 870 ] 3141 0.639% 99.323% ( 870, 1300 ] 1590 0.324% 99.647% ( 1300, 1900 ] 525 0.107% 99.753% ( 1900, 2900 ] 549 0.112% 99.865% ( 2900, 4400 ] 643 0.131% 99.996% ( 4400, 6600 ] 172 0.035% 100.031% ( 6600, 9900 ] 57 0.012% 100.043% ( 9900, 14000 ] 25 0.005% 100.048% ( 14000, 22000 ] 33 0.007% 100.055% ( 22000, 33000 ] 14 0.003% 100.057% ( 33000, 50000 ] 4 0.001% 100.058% ( 50000, 75000 ] 2 0.000% 100.059% ** Level 1 read latency histogram (micros): Count: 65689 Average: 19.9568 StdDev: 341.53 Min: 1 Median: 2.6486 Max: 32963 Percentiles: P50: 2.65 P75: 4.07 P99: 296.24 P99.9: 2739.61 P99.99: 17889.76 ------------------------------------------------------ [ 0, 1 ] 414 0.630% 0.630% ( 1, 2 ] 19378 29.500% 30.130% ###### ( 2, 3 ] 20123 30.634% 60.764% ###### ( 3, 4 ] 8931 13.596% 74.359% ### ( 4, 6 ] 11443 17.420% 91.779% ### ( 6, 10 ] 2888 4.396% 96.176% # ( 10, 15 ] 638 0.971% 97.147% ( 15, 22 ] 213 0.324% 97.471% ( 22, 34 ] 41 0.062% 97.534% ( 34, 51 ] 31 0.047% 97.581% ( 51, 76 ] 13 0.020% 97.601% ( 76, 110 ] 14 0.021% 97.622% ( 110, 170 ] 232 0.353% 97.975% ( 170, 250 ] 597 0.909% 98.884% ( 250, 380 ] 214 0.326% 99.210% ( 380, 580 ] 200 0.304% 99.514% ( 580, 870 ] 143 0.218% 99.732% ( 870, 1300 ] 68 0.104% 99.836% ( 1300, 1900 ] 23 0.035% 99.871% ( 1900, 2900 ] 23 0.035% 99.906% ( 2900, 4400 ] 27 0.041% 99.947% ( 4400, 6600 ] 10 0.015% 99.962% ( 6600, 9900 ] 11 0.017% 99.979% ( 9900, 14000 ] 5 0.008% 99.986% ( 14000, 22000 ] 5 0.008% 99.994% ( 22000, 33000 ] 4 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 329004 Average: 16.9847 StdDev: 290.46 Min: 1 Median: 2.3282 Max: 38978 Percentiles: P50: 2.33 P75: 3.38 P99: 14.14 P99.9: 2122.21 P99.99: 3381.55 ------------------------------------------------------ [ 0, 1 ] 3109 0.945% 0.945% ( 1, 2 ] 127988 38.902% 39.847% ######## ( 2, 3 ] 101775 30.934% 70.781% ###### ( 3, 4 ] 36106 10.974% 81.755% ## ( 4, 6 ] 43439 13.203% 94.958% ### ( 6, 10 ] 10867 3.303% 98.261% # ( 10, 15 ] 2932 0.891% 99.153% ( 15, 22 ] 486 0.148% 99.300% ( 22, 34 ] 67 0.020% 99.321% ( 34, 51 ] 117 0.036% 99.356% ( 51, 76 ] 108 0.033% 99.389% ( 76, 110 ] 50 0.015% 99.404% ( 110, 170 ] 39 0.012% 99.416% ( 170, 250 ] 78 0.024% 99.440% ( 250, 380 ] 303 0.092% 99.532% ( 380, 580 ] 453 0.138% 99.670% ( 580, 870 ] 358 0.109% 99.778% ( 870, 1300 ] 195 0.059% 99.838% ( 1300, 1900 ] 147 0.045% 99.882% ( 1900, 2900 ] 261 0.079% 99.962% ( 2900, 4400 ] 290 0.088% 100.050% ( 4400, 6600 ] 130 0.040% 100.089% ( 6600, 9900 ] 53 0.016% 100.105% ( 9900, 14000 ] 25 0.008% 100.113% ( 14000, 22000 ] 15 0.005% 100.118% ( 22000, 33000 ] 5 0.002% 100.119% ( 33000, 50000 ] 2 0.001% 100.120% ** Level 3 read latency histogram (micros): Count: 552750 Average: 18.7194 StdDev: 318.75 Min: 1 Median: 2.3531 Max: 57414 Percentiles: P50: 2.35 P75: 3.38 P99: 201.69 P99.9: 1356.45 P99.99: 2542.32 ------------------------------------------------------ [ 0, 1 ] 4405 0.797% 0.797% ( 1, 2 ] 209282 37.862% 38.659% ######## ( 2, 3 ] 177526 32.117% 70.776% ###### ( 3, 4 ] 61110 11.056% 81.831% ## ( 4, 6 ] 71044 12.853% 94.684% ### ( 6, 10 ] 17761 3.213% 97.897% # ( 10, 15 ] 3954 0.715% 98.613% ( 15, 22 ] 526 0.095% 98.708% ( 22, 34 ] 104 0.019% 98.727% ( 34, 51 ] 183 0.033% 98.760% ( 51, 76 ] 142 0.026% 98.786% ( 76, 110 ] 62 0.011% 98.797% ( 110, 170 ] 542 0.098% 98.895% ( 170, 250 ] 1468 0.266% 99.160% ( 250, 380 ] 1081 0.196% 99.356% ( 380, 580 ] 1308 0.237% 99.593% ( 580, 870 ] 1103 0.200% 99.792% ( 870, 1300 ] 570 0.103% 99.895% ( 1300, 1900 ] 279 0.050% 99.946% ( 1900, 2900 ] 381 0.069% 100.015% ( 2900, 4400 ] 466 0.084% 100.099% ( 4400, 6600 ] 125 0.023% 100.122% ( 6600, 9900 ] 64 0.012% 100.133% ( 9900, 14000 ] 28 0.005% 100.138% ( 14000, 22000 ] 40 0.007% 100.145% ( 22000, 33000 ] 16 0.003% 100.148% ( 33000, 50000 ] 6 0.001% 100.149% ( 50000, 75000 ] 1 0.000% 100.150% ** Level 4 read latency histogram (micros): Count: 952896 Average: 30.6796 StdDev: 380.89 Min: 0 Median: 2.3732 Max: 57292 Percentiles: P50: 2.37 P75: 3.53 P99: 491.66 P99.9: 1465.82 P99.99: 2145.57 ------------------------------------------------------ [ 0, 1 ] 8967 0.941% 0.941% ( 1, 2 ] 359289 37.705% 38.646% ######## ( 2, 3 ] 289884 30.421% 69.067% ###### ( 3, 4 ] 106441 11.170% 80.238% ## ( 4, 6 ] 119012 12.490% 92.727% ## ( 6, 10 ] 29832 3.131% 95.858% # ( 10, 15 ] 6949 0.729% 96.587% ( 15, 22 ] 876 0.092% 96.679% ( 22, 34 ] 125 0.013% 96.692% ( 34, 51 ] 203 0.021% 96.713% ( 51, 76 ] 180 0.019% 96.732% ( 76, 110 ] 172 0.018% 96.750% ( 110, 170 ] 3699 0.388% 97.139% ( 170, 250 ] 9834 1.032% 98.171% ( 250, 380 ] 5098 0.535% 98.706% ( 380, 580 ] 5026 0.527% 99.233% ( 580, 870 ] 4060 0.426% 99.659% ( 870, 1300 ] 2054 0.216% 99.875% ( 1300, 1900 ] 876 0.092% 99.967% ( 1900, 2900 ] 911 0.096% 100.062% ( 2900, 4400 ] 1272 0.133% 100.196% ( 4400, 6600 ] 361 0.038% 100.233% ( 6600, 9900 ] 142 0.015% 100.248% ( 9900, 14000 ] 52 0.005% 100.254% ( 14000, 22000 ] 74 0.008% 100.262% ( 22000, 33000 ] 48 0.005% 100.267% ( 33000, 50000 ] 13 0.001% 100.268% ( 50000, 75000 ] 3 0.000% 100.268% ** Level 5 read latency histogram (micros): Count: 22308 Average: 620.9333 StdDev: 1365.65 Min: 92 Median: 288.2887 Max: 49091 Percentiles: P50: 288.29 P75: 573.04 P99: 4651.11 P99.9: 23094.82 P99.99: 44582.34 ------------------------------------------------------ ( 76, 110 ] 100 0.448% 0.448% ( 110, 170 ] 2721 12.197% 12.646% ## ( 170, 250 ] 7278 32.625% 45.271% ####### ( 250, 380 ] 3582 16.057% 61.328% ### ( 380, 580 ] 3160 14.165% 75.493% ### ( 580, 870 ] 2386 10.696% 86.189% ## ( 870, 1300 ] 1177 5.276% 91.465% # ( 1300, 1900 ] 496 2.223% 93.688% ( 1900, 2900 ] 490 2.197% 95.885% ( 2900, 4400 ] 677 3.035% 98.920% # ( 4400, 6600 ] 157 0.704% 99.623% ( 6600, 9900 ] 37 0.166% 99.789% ( 9900, 14000 ] 10 0.045% 99.834% ( 14000, 22000 ] 13 0.058% 99.892% ( 22000, 33000 ] 17 0.076% 99.969% ( 33000, 50000 ] 7 0.031% 100.000% ** DB Stats ** Uptime(secs): 11.5 total, 4.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 170.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.737 H:M:S, 23.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 222.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.550 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/10-17:36:23 ... thread 0: (1000000,3000000) ops and (274262.6,198674.2) ops/second in (3.646141,15.100101) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.81 GB 262.8 2.5 0.0 2.5 5.3 2.8 0.0 1.9 77.0 165.0 32.69 19.35 51 0.641 2554K 13K 0.0 0.0 L1 8/0 713.22 MB 71.3 0.7 0.5 0.2 0.7 0.4 0.0 1.5 69.3 68.3 10.44 4.27 1 10.436 734K 9844 0.0 0.0 L3 20/0 949.69 MB 0.9 2.2 1.6 0.6 2.2 1.6 0.0 1.3 104.4 102.4 21.88 11.99 10 2.188 1628K 7543 0.0 0.0 L4 142/0 9.57 GB 1.0 5.8 2.1 3.7 5.2 1.5 0.3 2.4 126.9 113.2 47.05 29.41 22 2.139 1177K 0 0.0 0.0 L5 156/0 11.75 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 341/4 25.76 GB 0.0 11.2 4.2 7.0 13.4 6.4 2.9 4.7 102.6 122.1 112.06 65.03 84 1.334 6094K 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.2 4.2 7.0 13.4 6.4 2.9 4.7 102.6 122.1 112.06 65.03 84 1.334 6094K 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.2 4.2 7.0 10.5 3.5 0.0 0.0 116.7 109.5 98.52 56.66 42 2.346 6094K 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 213.6 13.54 8.38 42 0.322 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.1 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.36 GB write, 900.55 MB/s write, 11.22 GB read, 756.71 MB/s read, 112.1 seconds Interval compaction: 13.36 GB write, 905.66 MB/s write, 11.22 GB read, 761.01 MB/s read, 112.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 25, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 815666 Average: 27.4082 StdDev: 277.15 Min: 1 Median: 1.7080 Max: 53529 Percentiles: P50: 1.71 P75: 2.55 P99: 503.51 P99.9: 2207.88 P99.99: 3724.49 ------------------------------------------------------ [ 0, 1 ] 99097 12.149% 12.149% ## ( 1, 2 ] 436070 53.462% 65.611% ########### ( 2, 3 ] 139713 17.129% 82.740% ### ( 3, 4 ] 42042 5.154% 87.894% # ( 4, 6 ] 39388 4.829% 92.723% # ( 6, 10 ] 11952 1.465% 94.188% ( 10, 15 ] 2219 0.272% 94.460% ( 15, 22 ] 319 0.039% 94.499% ( 22, 34 ] 76 0.009% 94.509% ( 34, 51 ] 54 0.007% 94.515% ( 51, 76 ] 50 0.006% 94.522% ( 76, 110 ] 294 0.036% 94.558% ( 110, 170 ] 7932 0.972% 95.530% ( 170, 250 ] 18393 2.255% 97.785% ( 250, 380 ] 6923 0.849% 98.634% ( 380, 580 ] 4839 0.593% 99.227% ( 580, 870 ] 3197 0.392% 99.619% ( 870, 1300 ] 1599 0.196% 99.815% ( 1300, 1900 ] 525 0.064% 99.879% ( 1900, 2900 ] 550 0.067% 99.947% ( 2900, 4400 ] 643 0.079% 100.026% ( 4400, 6600 ] 172 0.021% 100.047% ( 6600, 9900 ] 57 0.007% 100.054% ( 9900, 14000 ] 25 0.003% 100.057% ( 14000, 22000 ] 33 0.004% 100.061% ( 22000, 33000 ] 14 0.002% 100.063% ( 33000, 50000 ] 4 0.000% 100.063% ( 50000, 75000 ] 2 0.000% 100.063% ** Level 1 read latency histogram (micros): Count: 67953 Average: 25.7085 StdDev: 337.56 Min: 1 Median: 2.7030 Max: 32963 Percentiles: P50: 2.70 P75: 4.36 P99: 354.42 P99.9: 2641.17 P99.99: 17527.52 ------------------------------------------------------ [ 0, 1 ] 414 0.609% 0.609% ( 1, 2 ] 19388 28.531% 29.141% ###### ( 2, 3 ] 20164 29.673% 58.814% ###### ( 3, 4 ] 8954 13.177% 71.991% ### ( 4, 6 ] 11467 16.875% 88.866% ### ( 6, 10 ] 2897 4.263% 93.129% # ( 10, 15 ] 641 0.943% 94.072% ( 15, 22 ] 213 0.313% 94.386% ( 22, 34 ] 41 0.060% 94.446% ( 34, 51 ] 31 0.046% 94.492% ( 51, 76 ] 13 0.019% 94.511% ( 76, 110 ] 48 0.071% 94.582% ( 110, 170 ] 915 1.347% 95.928% ( 170, 250 ] 1722 2.534% 98.462% # ( 250, 380 ] 455 0.670% 99.132% ( 380, 580 ] 262 0.386% 99.517% ( 580, 870 ] 151 0.222% 99.740% ( 870, 1300 ] 69 0.102% 99.841% ( 1300, 1900 ] 23 0.034% 99.875% ( 1900, 2900 ] 23 0.034% 99.909% ( 2900, 4400 ] 27 0.040% 99.948% ( 4400, 6600 ] 10 0.015% 99.963% ( 6600, 9900 ] 11 0.016% 99.979% ( 9900, 14000 ] 5 0.007% 99.987% ( 14000, 22000 ] 5 0.007% 99.994% ( 22000, 33000 ] 4 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 329004 Average: 16.9847 StdDev: 290.46 Min: 1 Median: 2.3282 Max: 38978 Percentiles: P50: 2.33 P75: 3.38 P99: 14.14 P99.9: 2122.21 P99.99: 3381.55 ------------------------------------------------------ [ 0, 1 ] 3109 0.945% 0.945% ( 1, 2 ] 127988 38.902% 39.847% ######## ( 2, 3 ] 101775 30.934% 70.781% ###### ( 3, 4 ] 36106 10.974% 81.755% ## ( 4, 6 ] 43439 13.203% 94.958% ### ( 6, 10 ] 10867 3.303% 98.261% # ( 10, 15 ] 2932 0.891% 99.153% ( 15, 22 ] 486 0.148% 99.300% ( 22, 34 ] 67 0.020% 99.321% ( 34, 51 ] 117 0.036% 99.356% ( 51, 76 ] 108 0.033% 99.389% ( 76, 110 ] 50 0.015% 99.404% ( 110, 170 ] 39 0.012% 99.416% ( 170, 250 ] 78 0.024% 99.440% ( 250, 380 ] 303 0.092% 99.532% ( 380, 580 ] 453 0.138% 99.670% ( 580, 870 ] 358 0.109% 99.778% ( 870, 1300 ] 195 0.059% 99.838% ( 1300, 1900 ] 147 0.045% 99.882% ( 1900, 2900 ] 261 0.079% 99.962% ( 2900, 4400 ] 290 0.088% 100.050% ( 4400, 6600 ] 130 0.040% 100.089% ( 6600, 9900 ] 53 0.016% 100.105% ( 9900, 14000 ] 25 0.008% 100.113% ( 14000, 22000 ] 15 0.005% 100.118% ( 22000, 33000 ] 5 0.002% 100.119% ( 33000, 50000 ] 2 0.001% 100.120% ** Level 3 read latency histogram (micros): Count: 556035 Average: 19.8184 StdDev: 318.20 Min: 1 Median: 2.3624 Max: 57414 Percentiles: P50: 2.36 P75: 3.42 P99: 238.68 P99.9: 1351.54 P99.99: 2542.40 ------------------------------------------------------ [ 0, 1 ] 4405 0.792% 0.792% ( 1, 2 ] 209282 37.638% 38.430% ######## ( 2, 3 ] 177526 31.927% 70.358% ###### ( 3, 4 ] 61110 10.990% 81.348% ## ( 4, 6 ] 71044 12.777% 94.125% ### ( 6, 10 ] 17761 3.194% 97.319% # ( 10, 15 ] 3954 0.711% 98.030% ( 15, 22 ] 526 0.095% 98.125% ( 22, 34 ] 104 0.019% 98.143% ( 34, 51 ] 183 0.033% 98.176% ( 51, 76 ] 142 0.026% 98.202% ( 76, 110 ] 116 0.021% 98.223% ( 110, 170 ] 1576 0.283% 98.506% ( 170, 250 ] 3198 0.575% 99.081% ( 250, 380 ] 1416 0.255% 99.336% ( 380, 580 ] 1426 0.256% 99.592% ( 580, 870 ] 1115 0.201% 99.793% ( 870, 1300 ] 571 0.103% 99.896% ( 1300, 1900 ] 279 0.050% 99.946% ( 1900, 2900 ] 382 0.069% 100.015% ( 2900, 4400 ] 466 0.084% 100.098% ( 4400, 6600 ] 125 0.022% 100.121% ( 6600, 9900 ] 64 0.012% 100.132% ( 9900, 14000 ] 28 0.005% 100.137% ( 14000, 22000 ] 40 0.007% 100.145% ( 22000, 33000 ] 16 0.003% 100.147% ( 33000, 50000 ] 6 0.001% 100.149% ( 50000, 75000 ] 1 0.000% 100.149% ** Level 4 read latency histogram (micros): Count: 979543 Average: 35.2853 StdDev: 376.89 Min: 0 Median: 2.4190 Max: 57292 Percentiles: P50: 2.42 P75: 3.72 P99: 499.53 P99.9: 1446.89 P99.99: 2141.54 ------------------------------------------------------ [ 0, 1 ] 8967 0.915% 0.915% ( 1, 2 ] 359303 36.681% 37.596% ####### ( 2, 3 ] 289969 29.602% 67.199% ###### ( 3, 4 ] 106533 10.876% 78.074% ## ( 4, 6 ] 119165 12.165% 90.240% ## ( 6, 10 ] 29856 3.048% 93.288% # ( 10, 15 ] 6955 0.710% 93.998% ( 15, 22 ] 877 0.090% 94.087% ( 22, 34 ] 126 0.013% 94.100% ( 34, 51 ] 203 0.021% 94.121% ( 51, 76 ] 180 0.018% 94.139% ( 76, 110 ] 584 0.060% 94.199% ( 110, 170 ] 11942 1.219% 95.418% ( 170, 250 ] 23808 2.431% 97.848% ( 250, 380 ] 7793 0.796% 98.644% ( 380, 580 ] 5834 0.596% 99.240% ( 580, 870 ] 4194 0.428% 99.668% ( 870, 1300 ] 2060 0.210% 99.878% ( 1300, 1900 ] 876 0.089% 99.968% ( 1900, 2900 ] 911 0.093% 100.061% ( 2900, 4400 ] 1272 0.130% 100.190% ( 4400, 6600 ] 361 0.037% 100.227% ( 6600, 9900 ] 142 0.014% 100.242% ( 9900, 14000 ] 52 0.005% 100.247% ( 14000, 22000 ] 74 0.008% 100.255% ( 22000, 33000 ] 48 0.005% 100.260% ( 33000, 50000 ] 13 0.001% 100.261% ( 50000, 75000 ] 3 0.000% 100.261% ** Level 5 read latency histogram (micros): Count: 41261 Average: 428.9897 StdDev: 1026.76 Min: 91 Median: 223.4212 Max: 49091 Percentiles: P50: 223.42 P75: 356.48 P99: 4019.77 P99.9: 12252.99 P99.99: 39979.47 ------------------------------------------------------ ( 76, 110 ] 429 1.040% 1.040% ( 110, 170 ] 8545 20.710% 21.749% #### ( 170, 250 ] 17456 42.306% 64.056% ######## ( 250, 380 ] 5513 13.361% 77.417% ### ( 380, 580 ] 3777 9.154% 86.571% ## ( 580, 870 ] 2449 5.935% 92.506% # ( 870, 1300 ] 1186 2.874% 95.381% # ( 1300, 1900 ] 498 1.207% 96.588% ( 1900, 2900 ] 490 1.188% 97.775% ( 2900, 4400 ] 677 1.641% 99.416% ( 4400, 6600 ] 157 0.381% 99.796% ( 6600, 9900 ] 37 0.090% 99.886% ( 9900, 14000 ] 10 0.024% 99.910% ( 14000, 22000 ] 13 0.032% 99.942% ( 22000, 33000 ] 17 0.041% 99.983% ( 33000, 50000 ] 7 0.017% 100.000% ** DB Stats ** Uptime(secs): 15.2 total, 3.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 194.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.737 H:M:S, 18.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/10-17:36:27 ... thread 0: (1000000,4000000) ops and (272699.4,213138.5) ops/second in (3.667042,18.767143) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/4 3.73 GB 356.7 3.4 0.0 3.4 7.2 3.7 0.0 1.9 89.1 185.7 39.54 25.81 70 0.565 3576K 18K 0.0 0.0 L1 8/0 713.22 MB 71.3 0.7 0.5 0.2 0.7 0.4 0.0 1.5 69.3 68.3 10.44 4.27 1 10.436 734K 9844 0.0 0.0 L3 20/0 949.69 MB 0.9 2.2 1.6 0.6 2.2 1.6 0.0 1.3 104.4 102.4 21.88 11.99 10 2.188 1628K 7543 0.0 0.0 L4 142/0 9.57 GB 1.0 5.8 2.1 3.7 5.2 1.5 0.3 2.4 126.9 113.2 47.05 29.41 22 2.139 1177K 0 0.0 0.0 L5 156/0 11.75 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 344/4 26.68 GB 0.0 12.2 4.2 8.0 15.3 7.3 2.9 4.1 105.1 131.4 118.91 71.49 103 1.154 7116K 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.2 4.2 8.0 15.3 7.3 2.9 4.1 105.1 131.4 118.91 71.49 103 1.154 7116K 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.2 4.2 8.0 11.5 3.5 0.0 0.0 122.0 115.0 102.48 60.52 46 2.228 7116K 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 233.6 16.43 10.97 57 0.288 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.9 total, 18.8 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.26 GB write, 828.59 MB/s write, 12.21 GB read, 662.93 MB/s read, 118.9 seconds Interval compaction: 15.26 GB write, 832.37 MB/s write, 12.21 GB read, 665.96 MB/s read, 118.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 25, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1090607 Average: 22.7874 StdDev: 240.59 Min: 1 Median: 1.6377 Max: 53529 Percentiles: P50: 1.64 P75: 2.34 P99: 396.18 P99.9: 1644.45 P99.99: 3382.75 ------------------------------------------------------ [ 0, 1 ] 162409 14.892% 14.892% ### ( 1, 2 ] 600459 55.057% 69.949% ########### ( 2, 3 ] 162978 14.944% 84.893% ### ( 3, 4 ] 49503 4.539% 89.432% # ( 4, 6 ] 44152 4.048% 93.480% # ( 6, 10 ] 13097 1.201% 94.681% ( 10, 15 ] 2594 0.238% 94.919% ( 15, 22 ] 391 0.036% 94.955% ( 22, 34 ] 97 0.009% 94.964% ( 34, 51 ] 58 0.005% 94.969% ( 51, 76 ] 54 0.005% 94.974% ( 76, 110 ] 528 0.048% 95.022% ( 110, 170 ] 11707 1.073% 96.096% ( 170, 250 ] 23628 2.166% 98.262% ( 250, 380 ] 7635 0.700% 98.962% ( 380, 580 ] 5092 0.467% 99.429% ( 580, 870 ] 3231 0.296% 99.725% ( 870, 1300 ] 1603 0.147% 99.872% ( 1300, 1900 ] 525 0.048% 99.921% ( 1900, 2900 ] 551 0.051% 99.971% ( 2900, 4400 ] 643 0.059% 100.030% ( 4400, 6600 ] 172 0.016% 100.046% ( 6600, 9900 ] 57 0.005% 100.051% ( 9900, 14000 ] 25 0.002% 100.053% ( 14000, 22000 ] 33 0.003% 100.056% ( 22000, 33000 ] 14 0.001% 100.058% ( 33000, 50000 ] 4 0.000% 100.058% ( 50000, 75000 ] 2 0.000% 100.058% ** Level 1 read latency histogram (micros): Count: 70307 Average: 31.2766 StdDev: 333.42 Min: 1 Median: 2.7613 Max: 32963 Percentiles: P50: 2.76 P75: 4.66 P99: 369.73 P99.9: 2538.83 P99.99: 17150.88 ------------------------------------------------------ [ 0, 1 ] 414 0.589% 0.589% ( 1, 2 ] 19388 27.576% 28.165% ###### ( 2, 3 ] 20164 28.680% 56.845% ###### ( 3, 4 ] 8954 12.736% 69.581% ### ( 4, 6 ] 11467 16.310% 85.890% ### ( 6, 10 ] 2897 4.121% 90.011% # ( 10, 15 ] 641 0.912% 90.923% ( 15, 22 ] 213 0.303% 91.226% ( 22, 34 ] 41 0.058% 91.284% ( 34, 51 ] 31 0.044% 91.328% ( 51, 76 ] 13 0.018% 91.347% ( 76, 110 ] 109 0.155% 91.502% ( 110, 170 ] 1777 2.527% 94.029% # ( 170, 250 ] 2923 4.157% 98.187% # ( 250, 380 ] 621 0.883% 99.070% ( 380, 580 ] 321 0.457% 99.526% ( 580, 870 ] 156 0.222% 99.748% ( 870, 1300 ] 69 0.098% 99.846% ( 1300, 1900 ] 23 0.033% 99.879% ( 1900, 2900 ] 23 0.033% 99.912% ( 2900, 4400 ] 27 0.038% 99.950% ( 4400, 6600 ] 10 0.014% 99.964% ( 6600, 9900 ] 11 0.016% 99.980% ( 9900, 14000 ] 5 0.007% 99.987% ( 14000, 22000 ] 5 0.007% 99.994% ( 22000, 33000 ] 4 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 329004 Average: 16.9847 StdDev: 290.46 Min: 1 Median: 2.3282 Max: 38978 Percentiles: P50: 2.33 P75: 3.38 P99: 14.14 P99.9: 2122.21 P99.99: 3381.55 ------------------------------------------------------ [ 0, 1 ] 3109 0.945% 0.945% ( 1, 2 ] 127988 38.902% 39.847% ######## ( 2, 3 ] 101775 30.934% 70.781% ###### ( 3, 4 ] 36106 10.974% 81.755% ## ( 4, 6 ] 43439 13.203% 94.958% ### ( 6, 10 ] 10867 3.303% 98.261% # ( 10, 15 ] 2932 0.891% 99.153% ( 15, 22 ] 486 0.148% 99.300% ( 22, 34 ] 67 0.020% 99.321% ( 34, 51 ] 117 0.036% 99.356% ( 51, 76 ] 108 0.033% 99.389% ( 76, 110 ] 50 0.015% 99.404% ( 110, 170 ] 39 0.012% 99.416% ( 170, 250 ] 78 0.024% 99.440% ( 250, 380 ] 303 0.092% 99.532% ( 380, 580 ] 453 0.138% 99.670% ( 580, 870 ] 358 0.109% 99.778% ( 870, 1300 ] 195 0.059% 99.838% ( 1300, 1900 ] 147 0.045% 99.882% ( 1900, 2900 ] 261 0.079% 99.962% ( 2900, 4400 ] 290 0.088% 100.050% ( 4400, 6600 ] 130 0.040% 100.089% ( 6600, 9900 ] 53 0.016% 100.105% ( 9900, 14000 ] 25 0.008% 100.113% ( 14000, 22000 ] 15 0.005% 100.118% ( 22000, 33000 ] 5 0.002% 100.119% ( 33000, 50000 ] 2 0.001% 100.120% ** Level 3 read latency histogram (micros): Count: 559372 Average: 20.8437 StdDev: 317.56 Min: 1 Median: 2.3718 Max: 57414 Percentiles: P50: 2.37 P75: 3.46 P99: 247.31 P99.9: 1344.36 P99.99: 2541.53 ------------------------------------------------------ [ 0, 1 ] 4405 0.787% 0.787% ( 1, 2 ] 209282 37.414% 38.201% ####### ( 2, 3 ] 177526 31.737% 69.938% ###### ( 3, 4 ] 61110 10.925% 80.863% ## ( 4, 6 ] 71044 12.701% 93.563% ### ( 6, 10 ] 17761 3.175% 96.738% # ( 10, 15 ] 3954 0.707% 97.445% ( 15, 22 ] 526 0.094% 97.539% ( 22, 34 ] 104 0.019% 97.558% ( 34, 51 ] 183 0.033% 97.591% ( 51, 76 ] 142 0.025% 97.616% ( 76, 110 ] 190 0.034% 97.650% ( 110, 170 ] 2792 0.499% 98.149% ( 170, 250 ] 4925 0.880% 99.030% ( 250, 380 ] 1654 0.296% 99.325% ( 380, 580 ] 1496 0.267% 99.593% ( 580, 870 ] 1127 0.201% 99.794% ( 870, 1300 ] 571 0.102% 99.896% ( 1300, 1900 ] 279 0.050% 99.946% ( 1900, 2900 ] 382 0.068% 100.014% ( 2900, 4400 ] 466 0.083% 100.098% ( 4400, 6600 ] 125 0.022% 100.120% ( 6600, 9900 ] 64 0.011% 100.132% ( 9900, 14000 ] 28 0.005% 100.137% ( 14000, 22000 ] 40 0.007% 100.144% ( 22000, 33000 ] 16 0.003% 100.147% ( 33000, 50000 ] 6 0.001% 100.148% ( 50000, 75000 ] 1 0.000% 100.148% ** Level 4 read latency histogram (micros): Count: 1006564 Average: 39.4510 StdDev: 372.79 Min: 0 Median: 2.4656 Max: 57292 Percentiles: P50: 2.47 P75: 3.91 P99: 501.05 P99.9: 1428.38 P99.99: 2138.58 ------------------------------------------------------ [ 0, 1 ] 8967 0.891% 0.891% ( 1, 2 ] 359303 35.696% 36.587% ####### ( 2, 3 ] 289969 28.808% 65.395% ###### ( 3, 4 ] 106533 10.584% 75.978% ## ( 4, 6 ] 119165 11.839% 87.817% ## ( 6, 10 ] 29856 2.966% 90.783% # ( 10, 15 ] 6955 0.691% 91.474% ( 15, 22 ] 877 0.087% 91.561% ( 22, 34 ] 126 0.013% 91.574% ( 34, 51 ] 203 0.020% 91.594% ( 51, 76 ] 180 0.018% 91.612% ( 76, 110 ] 1215 0.121% 91.733% ( 110, 170 ] 22283 2.214% 93.947% ( 170, 250 ] 37315 3.707% 97.654% # ( 250, 380 ] 9647 0.958% 98.612% ( 380, 580 ] 6451 0.641% 99.253% ( 580, 870 ] 4260 0.423% 99.676% ( 870, 1300 ] 2065 0.205% 99.881% ( 1300, 1900 ] 876 0.087% 99.968% ( 1900, 2900 ] 911 0.091% 100.059% ( 2900, 4400 ] 1272 0.126% 100.185% ( 4400, 6600 ] 361 0.036% 100.221% ( 6600, 9900 ] 142 0.014% 100.235% ( 9900, 14000 ] 52 0.005% 100.240% ( 14000, 22000 ] 74 0.007% 100.248% ( 22000, 33000 ] 48 0.005% 100.253% ( 33000, 50000 ] 13 0.001% 100.254% ( 50000, 75000 ] 3 0.000% 100.254% ** Level 5 read latency histogram (micros): Count: 60559 Average: 353.1653 StdDev: 855.62 Min: 90 Median: 209.9692 Max: 49091 Percentiles: P50: 209.97 P75: 278.62 P99: 3592.19 P99.9: 8690.68 P99.99: 35292.81 ------------------------------------------------------ ( 76, 110 ] 904 1.493% 1.493% ( 110, 170 ] 15767 26.036% 27.529% ##### ( 170, 250 ] 27238 44.978% 72.506% ######### ( 250, 380 ] 6859 11.326% 83.832% ## ( 380, 580 ] 4194 6.925% 90.758% # ( 580, 870 ] 2496 4.122% 94.879% # ( 870, 1300 ] 1191 1.967% 96.846% ( 1300, 1900 ] 499 0.824% 97.670% ( 1900, 2900 ] 493 0.814% 98.484% ( 2900, 4400 ] 677 1.118% 99.602% ( 4400, 6600 ] 157 0.259% 99.861% ( 6600, 9900 ] 37 0.061% 99.922% ( 9900, 14000 ] 10 0.017% 99.939% ( 14000, 22000 ] 13 0.021% 99.960% ( 22000, 33000 ] 17 0.028% 99.988% ( 33000, 50000 ] 7 0.012% 100.000% ** DB Stats ** Uptime(secs): 18.9 total, 3.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 208.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.812 H:M:S, 14.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 268.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.075 H:M:S, 2.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 394.359 micros/op 10105 ops/sec 20.186 seconds 203996 operations; 9.8 MB/s (51999 of 51999 found) Microseconds per read: Count: 203996 Average: 394.3669 StdDev: 1219.09 Min: 2 Median: 234.2683 Max: 109122 Percentiles: P50: 234.27 P75: 352.01 P99: 3592.42 P99.9: 19333.58 P99.99: 45076.10 ------------------------------------------------------ ( 1, 2 ] 7 0.003% 0.003% ( 2, 3 ] 37 0.018% 0.022% ( 3, 4 ] 66 0.032% 0.054% ( 4, 6 ] 180 0.088% 0.142% ( 6, 10 ] 341 0.167% 0.309% ( 10, 15 ] 1128 0.553% 0.862% ( 15, 22 ] 3126 1.532% 2.395% ( 22, 34 ] 4254 2.085% 4.480% ( 34, 51 ] 2903 1.423% 5.903% ( 51, 76 ] 526 0.258% 6.161% ( 76, 110 ] 182 0.089% 6.250% ( 110, 170 ] 16281 7.981% 14.231% ## ( 170, 250 ] 90828 44.524% 58.756% ######### ( 250, 380 ] 42230 20.701% 79.457% #### ( 380, 580 ] 22360 10.961% 90.418% ## ( 580, 870 ] 9854 4.830% 95.248% # ( 870, 1300 ] 4148 2.033% 97.282% ( 1300, 1900 ] 1561 0.765% 98.047% ( 1900, 2900 ] 1199 0.588% 98.635% ( 2900, 4400 ] 1614 0.791% 99.426% ( 4400, 6600 ] 534 0.262% 99.688% ( 6600, 9900 ] 232 0.114% 99.801% ( 9900, 14000 ] 113 0.055% 99.857% ( 14000, 22000 ] 132 0.065% 99.922% ( 22000, 33000 ] 119 0.058% 99.980% ( 33000, 50000 ] 29 0.014% 99.994% ( 50000, 75000 ] 7 0.003% 99.998% ( 75000, 110000 ] 5 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3204461 rocksdb.bloom.filter.full.positive COUNT : 234649 rocksdb.bloom.filter.full.true.positive COUNT : 203074 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 922 rocksdb.memtable.miss COUNT : 203074 rocksdb.l0.hit COUNT : 24962 rocksdb.l1.hit COUNT : 5353 rocksdb.l2andup.hit COUNT : 172759 rocksdb.compaction.key.drop.new COUNT : 727728 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4279655 rocksdb.number.keys.read COUNT : 203996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4416603960 rocksdb.bytes.read COUNT : 203996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 517 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3179878 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 13397386832 rocksdb.compact.write.bytes COUNT : 12641878073 rocksdb.flush.write.bytes COUNT : 4353207812 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 25 rocksdb.number.superversion_acquires COUNT : 757 rocksdb.number.superversion_releases COUNT : 729 rocksdb.number.superversion_cleanups COUNT : 186 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 171 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4324643840 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7663616 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 13342947129 rocksdb.non.last.level.read.count COUNT : 3192712 rocksdb.block.checksum.compute.count COUNT : 3481890 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 233.492982 P95 : 854.375751 P99 : 3592.416357 P100 : 109121.000000 COUNT : 203996 SUM : 80249175 rocksdb.db.write.micros P50 : 1.566136 P95 : 5.051208 P99 : 7.176304 P100 : 733024.000000 COUNT : 4279655 SUM : 14887015 rocksdb.compaction.times.micros P50 : 1971428.571429 P95 : 4055000.000000 P99 : 10436029.000000 P100 : 10436029.000000 COUNT : 47 SUM : 103429041 rocksdb.compaction.times.cpu_micros P50 : 1191052.631579 P95 : 1888333.333333 P99 : 3642000.000000 P100 : 4274033.000000 COUNT : 47 SUM : 61452927 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 828.571429 P95 : 8992.500000 P99 : 55933.000000 P100 : 55933.000000 COUNT : 62 SUM : 156295 rocksdb.compaction.outfile.sync.micros P50 : 2663.157895 P95 : 9063.214286 P99 : 13303.000000 P100 : 35077.000000 COUNT : 151 SUM : 510347 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 169.347826 P95 : 1885.000000 P99 : 6138.000000 P100 : 26810.000000 COUNT : 121 SUM : 74100 rocksdb.table.open.io.micros P50 : 5900.000000 P95 : 18344.000000 P99 : 21652.800000 P100 : 23086.000000 COUNT : 517 SUM : 3380167 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.413540 P95 : 9.708330 P99 : 203.226601 P100 : 57298.000000 COUNT : 3243860 SUM : 53944778 rocksdb.read.block.get.micros P50 : 200.866872 P95 : 755.381486 P99 : 3136.917253 P100 : 57420.000000 COUNT : 237496 SUM : 71046758 rocksdb.write.raw.block.micros P50 : 0.535679 P95 : 1.383739 P99 : 4.221158 P100 : 79697.000000 COUNT : 4116722 SUM : 16464224 rocksdb.numfiles.in.singlecompaction P50 : 3.220000 P95 : 5.762500 P99 : 25.000000 P100 : 25.000000 COUNT : 59 SUM : 237 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558049 P95 : 1106.341912 P99 : 1287.194853 P100 : 732826.000000 COUNT : 5720 SUM : 3180378 rocksdb.sst.read.micros P50 : 2.091703 P95 : 187.636136 P99 : 531.744182 P100 : 57414.000000 COUNT : 3192723 SUM : 110931667 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 203996 SUM : 203996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4279655 SUM : 4416603960 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 222765.957447 P95 : 707750.000000 P99 : 989200.000000 P100 : 1043169.000000 COUNT : 62 SUM : 17355326 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 171 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0