[2024-07-12 19:28:53.562231] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 23.11.0 initialization... [2024-07-12 19:28:53.562366] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1759561 ] Set seed to 1720805333558905 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-12 19:28:53.663918] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-12 19:28:53.703639] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-12 19:28:53.703690] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1759561' to capture a snapshot of events at runtime. [2024-07-12 19:28:53.703700] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-12 19:28:53.703711] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-12 19:28:53.703719] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1759561 for offline analysis/debug. [2024-07-12 19:28:53.703806] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 12 19:28:58 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/12-19:29:05 ... thread 0: (1000000,1000000) ops and (132650.5,132650.5) ops/second in (7.538605,7.538605) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.61 GB 56.6 0.4 0.0 0.4 1.2 0.9 0.0 1.4 39.1 130.2 9.67 3.97 11 0.879 383K 517 0.0 0.0 L1 7/7 734.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 11/10 1.38 GB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 31/8 1.79 GB 1.0 2.6 1.8 0.8 2.5 1.7 0.0 1.4 103.8 102.9 25.20 11.99 12 2.100 643K 0 0.0 0.0 L4 177/6 9.78 GB 1.0 2.5 1.5 1.0 2.5 1.4 0.0 1.7 109.8 108.3 23.36 11.54 18 1.298 1432K 0 0.0 0.0 L5 1096/0 90.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/41 105.66 GB 0.0 5.4 3.2 2.2 6.2 4.0 1.4 7.2 95.4 109.6 58.23 27.51 41 1.420 2459K 517 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 3.2 2.2 6.2 4.0 1.4 7.2 95.4 109.6 58.23 27.51 41 1.420 2459K 517 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 3.2 2.2 5.4 3.2 0.0 0.0 108.3 107.2 51.31 25.04 31 1.655 2459K 517 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 127.5 6.92 2.47 10 0.692 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.5 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.23 GB write, 830.32 MB/s write, 5.43 GB read, 722.96 MB/s read, 58.2 seconds Interval compaction: 6.23 GB write, 846.40 MB/s write, 5.43 GB read, 736.97 MB/s read, 58.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 28, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 331870 Average: 14.0407 StdDev: 151.39 Min: 1 Median: 1.9236 Max: 11710 Percentiles: P50: 1.92 P75: 2.97 P99: 15.33 P99.9: 2141.09 P99.99: 3652.43 ------------------------------------------------------ [ 0, 1 ] 11856 3.572% 3.572% # ( 1, 2 ] 166820 50.267% 53.839% ########## ( 2, 3 ] 72224 21.763% 75.602% #### ( 3, 4 ] 33134 9.984% 85.586% ## ( 4, 6 ] 35229 10.615% 96.201% ## ( 6, 10 ] 7686 2.316% 98.517% ( 10, 15 ] 1595 0.481% 98.998% ( 15, 22 ] 196 0.059% 99.057% ( 22, 34 ] 21 0.006% 99.063% ( 34, 51 ] 16 0.005% 99.068% ( 51, 76 ] 16 0.005% 99.073% ( 76, 110 ] 14 0.004% 99.077% ( 110, 170 ] 41 0.012% 99.089% ( 170, 250 ] 138 0.042% 99.131% ( 250, 380 ] 273 0.082% 99.213% ( 380, 580 ] 514 0.155% 99.368% ( 580, 870 ] 724 0.218% 99.586% ( 870, 1300 ] 628 0.189% 99.776% ( 1300, 1900 ] 351 0.106% 99.881% ( 1900, 2900 ] 266 0.080% 99.961% ( 2900, 4400 ] 193 0.058% 100.020% ( 4400, 6600 ] 49 0.015% 100.034% ( 6600, 9900 ] 4 0.001% 100.036% ( 9900, 14000 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 23087 Average: 21.8115 StdDev: 220.09 Min: 1 Median: 1.9436 Max: 6492 Percentiles: P50: 1.94 P75: 2.99 P99: 535.65 P99.9: 4061.83 P99.99: 6301.23 ------------------------------------------------------ [ 0, 1 ] 535 2.317% 2.317% ( 1, 2 ] 11666 50.531% 52.848% ########## ( 2, 3 ] 5185 22.459% 75.306% #### ( 3, 4 ] 2275 9.854% 85.160% ## ( 4, 6 ] 2345 10.157% 95.318% ## ( 6, 10 ] 625 2.707% 98.025% # ( 10, 15 ] 135 0.585% 98.610% ( 15, 22 ] 13 0.056% 98.666% ( 22, 34 ] 3 0.013% 98.679% ( 34, 51 ] 1 0.004% 98.683% ( 51, 76 ] 1 0.004% 98.688% ( 76, 110 ] 2 0.009% 98.696% ( 110, 170 ] 13 0.056% 98.753% ( 170, 250 ] 12 0.052% 98.805% ( 250, 380 ] 14 0.061% 98.865% ( 380, 580 ] 40 0.173% 99.038% ( 580, 870 ] 53 0.230% 99.268% ( 870, 1300 ] 61 0.264% 99.532% ( 1300, 1900 ] 35 0.152% 99.684% ( 1900, 2900 ] 29 0.126% 99.809% ( 2900, 4400 ] 27 0.117% 99.926% ( 4400, 6600 ] 17 0.074% 100.000% ** Level 2 read latency histogram (micros): Count: 463869 Average: 12.3327 StdDev: 150.17 Min: 1 Median: 2.0110 Max: 10635 Percentiles: P50: 2.01 P75: 3.11 P99: 12.85 P99.9: 1657.45 P99.99: 2701.38 ------------------------------------------------------ [ 0, 1 ] 8837 1.905% 1.905% ( 1, 2 ] 221866 47.829% 49.735% ########## ( 2, 3 ] 111985 24.142% 73.876% ##### ( 3, 4 ] 48939 10.550% 84.426% ## ( 4, 6 ] 52847 11.393% 95.819% ## ( 6, 10 ] 13015 2.806% 98.625% # ( 10, 15 ] 3059 0.659% 99.284% ( 15, 22 ] 427 0.092% 99.376% ( 22, 34 ] 66 0.014% 99.390% ( 34, 51 ] 28 0.006% 99.396% ( 51, 76 ] 29 0.006% 99.403% ( 76, 110 ] 20 0.004% 99.407% ( 110, 170 ] 51 0.011% 99.418% ( 170, 250 ] 93 0.020% 99.438% ( 250, 380 ] 208 0.045% 99.483% ( 380, 580 ] 429 0.092% 99.575% ( 580, 870 ] 619 0.133% 99.709% ( 870, 1300 ] 625 0.135% 99.843% ( 1300, 1900 ] 440 0.095% 99.938% ( 1900, 2900 ] 299 0.064% 100.003% ( 2900, 4400 ] 276 0.059% 100.062% ( 4400, 6600 ] 74 0.016% 100.078% ( 6600, 9900 ] 17 0.004% 100.082% ( 9900, 14000 ] 1 0.000% 100.082% ** Level 3 read latency histogram (micros): Count: 621379 Average: 9.4891 StdDev: 127.27 Min: 1 Median: 1.9757 Max: 9367 Percentiles: P50: 1.98 P75: 3.05 P99: 9.81 P99.9: 915.17 P99.99: 1419.47 ------------------------------------------------------ [ 0, 1 ] 14097 2.269% 2.269% ( 1, 2 ] 303974 48.919% 51.188% ########## ( 2, 3 ] 144853 23.312% 74.499% ##### ( 3, 4 ] 67547 10.870% 85.370% ## ( 4, 6 ] 70847 11.402% 96.772% ## ( 6, 10 ] 14552 2.342% 99.113% ( 10, 15 ] 3082 0.496% 99.609% ( 15, 22 ] 421 0.068% 99.677% ( 22, 34 ] 50 0.008% 99.685% ( 34, 51 ] 49 0.008% 99.693% ( 51, 76 ] 37 0.006% 99.699% ( 76, 110 ] 18 0.003% 99.702% ( 110, 170 ] 47 0.008% 99.710% ( 170, 250 ] 73 0.012% 99.721% ( 250, 380 ] 187 0.030% 99.751% ( 380, 580 ] 355 0.057% 99.808% ( 580, 870 ] 513 0.083% 99.891% ( 870, 1300 ] 539 0.087% 99.978% ( 1300, 1900 ] 386 0.062% 100.040% ( 1900, 2900 ] 327 0.053% 100.093% ( 2900, 4400 ] 270 0.043% 100.136% ( 4400, 6600 ] 85 0.014% 100.150% ( 6600, 9900 ] 11 0.002% 100.151% ** Level 4 read latency histogram (micros): Count: 268084 Average: 27.0252 StdDev: 236.21 Min: 1 Median: 1.9453 Max: 9474 Percentiles: P50: 1.95 P75: 3.00 P99: 803.62 P99.9: 3085.64 P99.99: 4061.15 ------------------------------------------------------ [ 0, 1 ] 6868 2.562% 2.562% # ( 1, 2 ] 134530 50.182% 52.744% ########## ( 2, 3 ] 59632 22.244% 74.988% #### ( 3, 4 ] 27057 10.093% 85.080% ## ( 4, 6 ] 27049 10.090% 95.170% ## ( 6, 10 ] 6745 2.516% 97.686% # ( 10, 15 ] 1398 0.521% 98.208% ( 15, 22 ] 196 0.073% 98.281% ( 22, 34 ] 18 0.007% 98.287% ( 34, 51 ] 10 0.004% 98.291% ( 51, 76 ] 15 0.006% 98.297% ( 76, 110 ] 12 0.004% 98.301% ( 110, 170 ] 60 0.022% 98.324% ( 170, 250 ] 165 0.062% 98.385% ( 250, 380 ] 331 0.123% 98.509% ( 380, 580 ] 590 0.220% 98.729% ( 580, 870 ] 943 0.352% 99.081% ( 870, 1300 ] 982 0.366% 99.447% ( 1300, 1900 ] 667 0.249% 99.696% ( 1900, 2900 ] 502 0.187% 99.883% ( 2900, 4400 ] 371 0.138% 100.021% ( 4400, 6600 ] 135 0.050% 100.072% ( 6600, 9900 ] 14 0.005% 100.077% ** Level 5 read latency histogram (micros): Count: 13407 Average: 1582.8315 StdDev: 1434.41 Min: 86 Median: 1067.7240 Max: 12830 Percentiles: P50: 1067.72 P75: 2118.02 P99: 6565.71 P99.9: 9692.86 P99.99: 12830.00 ------------------------------------------------------ ( 76, 110 ] 23 0.172% 0.172% ( 110, 170 ] 149 1.111% 1.283% ( 170, 250 ] 350 2.611% 3.893% # ( 250, 380 ] 872 6.504% 10.398% # ( 380, 580 ] 1764 13.157% 23.555% ### ( 580, 870 ] 2401 17.909% 41.463% #### ( 870, 1300 ] 2489 18.565% 60.028% #### ( 1300, 1900 ] 1709 12.747% 72.775% ### ( 1900, 2900 ] 1368 10.204% 82.979% ## ( 2900, 4400 ] 1512 11.278% 94.257% ## ( 4400, 6600 ] 646 4.818% 99.075% # ( 6600, 9900 ] 118 0.880% 99.955% ( 9900, 14000 ] 6 0.045% 100.000% ** DB Stats ** Uptime(secs): 7.7 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 128.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.479 H:M:S, 45.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.479 H:M:S, 46.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/12-19:29:10 ... thread 0: (1000000,2000000) ops and (222788.8,166290.3) ops/second in (4.488555,12.027160) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 2.60 GB 163.6 1.4 0.0 1.4 3.2 1.8 0.0 1.7 74.9 176.8 18.51 10.71 28 0.661 1407K 1821 0.0 0.0 L1 7/7 734.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/0 962.73 MB 1.0 4.1 3.1 0.9 4.0 3.1 0.0 1.3 113.6 112.9 36.54 19.04 15 2.436 706K 0 0.0 0.0 L4 175/0 9.73 GB 1.0 4.9 3.7 1.2 4.8 3.6 0.0 1.3 120.2 119.2 41.65 22.65 38 1.096 3791K 341 0.0 0.0 L5 1124/0 92.64 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1344/17 106.63 GB 0.0 10.3 6.8 3.5 12.1 8.6 3.6 6.5 109.0 127.8 96.70 52.39 81 1.194 5905K 2162 0.0 0.0 Int 0/0 0.00 KB 0.0 10.3 6.8 3.5 12.1 8.6 3.6 6.5 109.0 127.8 96.70 52.39 81 1.194 5905K 2162 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.3 6.8 3.5 10.2 6.8 0.0 0.0 123.3 122.5 85.47 47.09 57 1.500 5905K 2162 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 168.3 11.23 5.30 24 0.468 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.07 GB write, 1015.45 MB/s write, 10.30 GB read, 865.91 MB/s read, 96.7 seconds Interval compaction: 12.07 GB write, 1027.78 MB/s write, 10.30 GB read, 876.43 MB/s read, 96.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 41, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 581608 Average: 15.5884 StdDev: 151.02 Min: 1 Median: 1.8145 Max: 16329 Percentiles: P50: 1.81 P75: 2.79 P99: 330.05 P99.9: 2054.64 P99.99: 3820.78 ------------------------------------------------------ [ 0, 1 ] 39585 6.806% 6.806% # ( 1, 2 ] 308431 53.031% 59.837% ########### ( 2, 3 ] 111204 19.120% 78.957% #### ( 3, 4 ] 48652 8.365% 87.322% ## ( 4, 6 ] 49669 8.540% 95.862% ## ( 6, 10 ] 10014 1.722% 97.584% ( 10, 15 ] 2043 0.351% 97.935% ( 15, 22 ] 248 0.043% 97.978% ( 22, 34 ] 24 0.004% 97.982% ( 34, 51 ] 19 0.003% 97.985% ( 51, 76 ] 29 0.005% 97.990% ( 76, 110 ] 685 0.118% 98.108% ( 110, 170 ] 2450 0.421% 98.529% ( 170, 250 ] 1852 0.318% 98.848% ( 250, 380 ] 1442 0.248% 99.095% ( 380, 580 ] 1622 0.279% 99.374% ( 580, 870 ] 1470 0.253% 99.627% ( 870, 1300 ] 991 0.170% 99.797% ( 1300, 1900 ] 536 0.092% 99.890% ( 1900, 2900 ] 397 0.068% 99.958% ( 2900, 4400 ] 306 0.053% 100.010% ( 4400, 6600 ] 88 0.015% 100.026% ( 6600, 9900 ] 12 0.002% 100.028% ( 9900, 14000 ] 1 0.000% 100.028% ( 14000, 22000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 93344 Average: 9.8637 StdDev: 116.92 Min: 1 Median: 2.3083 Max: 6492 Percentiles: P50: 2.31 P75: 3.53 P99: 20.18 P99.9: 1725.48 P99.99: 5459.13 ------------------------------------------------------ [ 0, 1 ] 1379 1.477% 1.477% ( 1, 2 ] 37641 40.325% 41.802% ######## ( 2, 3 ] 24817 26.587% 68.389% ##### ( 3, 4 ] 11696 12.530% 80.919% ### ( 4, 6 ] 12340 13.220% 94.139% ### ( 6, 10 ] 3577 3.832% 97.971% # ( 10, 15 ] 771 0.826% 98.797% ( 15, 22 ] 256 0.274% 99.071% ( 22, 34 ] 28 0.030% 99.101% ( 34, 51 ] 5 0.005% 99.107% ( 51, 76 ] 4 0.004% 99.111% ( 76, 110 ] 42 0.045% 99.156% ( 110, 170 ] 175 0.187% 99.343% ( 170, 250 ] 128 0.137% 99.480% ( 250, 380 ] 90 0.096% 99.577% ( 380, 580 ] 112 0.120% 99.697% ( 580, 870 ] 88 0.094% 99.791% ( 870, 1300 ] 74 0.079% 99.870% ( 1300, 1900 ] 39 0.042% 99.912% ( 1900, 2900 ] 35 0.037% 99.950% ( 2900, 4400 ] 29 0.031% 99.981% ( 4400, 6600 ] 18 0.019% 100.000% ** Level 2 read latency histogram (micros): Count: 582066 Average: 11.3143 StdDev: 143.79 Min: 1 Median: 1.9695 Max: 15875 Percentiles: P50: 1.97 P75: 2.98 P99: 12.40 P99.9: 1611.60 P99.99: 2814.53 ------------------------------------------------------ [ 0, 1 ] 11705 2.011% 2.011% ( 1, 2 ] 288102 49.496% 51.507% ########## ( 2, 3 ] 139778 24.014% 75.522% ##### ( 3, 4 ] 57897 9.947% 85.468% ## ( 4, 6 ] 61272 10.527% 95.995% ## ( 6, 10 ] 15744 2.705% 98.700% # ( 10, 15 ] 3633 0.624% 99.324% ( 15, 22 ] 500 0.086% 99.410% ( 22, 34 ] 76 0.013% 99.423% ( 34, 51 ] 30 0.005% 99.428% ( 51, 76 ] 30 0.005% 99.433% ( 76, 110 ] 28 0.005% 99.438% ( 110, 170 ] 128 0.022% 99.460% ( 170, 250 ] 164 0.028% 99.488% ( 250, 380 ] 271 0.047% 99.535% ( 380, 580 ] 503 0.086% 99.621% ( 580, 870 ] 702 0.121% 99.742% ( 870, 1300 ] 681 0.117% 99.859% ( 1300, 1900 ] 462 0.079% 99.938% ( 1900, 2900 ] 330 0.057% 99.995% ( 2900, 4400 ] 311 0.053% 100.048% ( 4400, 6600 ] 87 0.015% 100.063% ( 6600, 9900 ] 19 0.003% 100.066% ( 9900, 14000 ] 1 0.000% 100.067% ( 14000, 22000 ] 1 0.000% 100.067% ** Level 3 read latency histogram (micros): Count: 1082986 Average: 9.1628 StdDev: 136.63 Min: 1 Median: 1.9704 Max: 17816 Percentiles: P50: 1.97 P75: 2.98 P99: 9.63 P99.9: 552.25 P99.99: 970.02 ------------------------------------------------------ [ 0, 1 ] 19889 1.836% 1.836% ( 1, 2 ] 537502 49.631% 51.468% ########## ( 2, 3 ] 260191 24.025% 75.493% ##### ( 3, 4 ] 115672 10.681% 86.174% ## ( 4, 6 ] 117832 10.880% 97.054% ## ( 6, 10 ] 23233 2.145% 99.200% ( 10, 15 ] 5284 0.488% 99.688% ( 15, 22 ] 621 0.057% 99.745% ( 22, 34 ] 69 0.006% 99.751% ( 34, 51 ] 75 0.007% 99.758% ( 51, 76 ] 85 0.008% 99.766% ( 76, 110 ] 85 0.008% 99.774% ( 110, 170 ] 263 0.024% 99.798% ( 170, 250 ] 260 0.024% 99.822% ( 250, 380 ] 358 0.033% 99.855% ( 380, 580 ] 562 0.052% 99.907% ( 580, 870 ] 729 0.067% 99.975% ( 870, 1300 ] 721 0.067% 100.041% ( 1300, 1900 ] 491 0.045% 100.086% ( 1900, 2900 ] 505 0.047% 100.133% ( 2900, 4400 ] 462 0.043% 100.176% ( 4400, 6600 ] 173 0.016% 100.192% ( 6600, 9900 ] 45 0.004% 100.196% ( 9900, 14000 ] 6 0.001% 100.196% ( 14000, 22000 ] 3 0.000% 100.197% ** Level 4 read latency histogram (micros): Count: 314521 Average: 31.9749 StdDev: 252.68 Min: 1 Median: 1.9509 Max: 31743 Percentiles: P50: 1.95 P75: 3.04 P99: 883.40 P99.9: 3320.74 P99.99: 4199.84 ------------------------------------------------------ [ 0, 1 ] 7927 2.520% 2.520% # ( 1, 2 ] 157046 49.932% 52.452% ########## ( 2, 3 ] 69606 22.131% 74.583% #### ( 3, 4 ] 30745 9.775% 84.358% ## ( 4, 6 ] 30174 9.594% 93.952% ## ( 6, 10 ] 7427 2.361% 96.313% ( 10, 15 ] 1574 0.500% 96.814% ( 15, 22 ] 211 0.067% 96.881% ( 22, 34 ] 20 0.006% 96.887% ( 34, 51 ] 12 0.004% 96.891% ( 51, 76 ] 15 0.005% 96.896% ( 76, 110 ] 382 0.121% 97.017% ( 110, 170 ] 1394 0.443% 97.460% ( 170, 250 ] 1111 0.353% 97.814% ( 250, 380 ] 988 0.314% 98.128% ( 380, 580 ] 1290 0.410% 98.538% ( 580, 870 ] 1413 0.449% 98.987% ( 870, 1300 ] 1309 0.416% 99.403% ( 1300, 1900 ] 813 0.258% 99.662% ( 1900, 2900 ] 614 0.195% 99.857% ( 2900, 4400 ] 483 0.154% 100.010% ( 4400, 6600 ] 158 0.050% 100.061% ( 6600, 9900 ] 18 0.006% 100.066% ( 9900, 14000 ] 1 0.000% 100.067% ( 22000, 33000 ] 1 0.000% 100.067% ** Level 5 read latency histogram (micros): Count: 45161 Average: 746.9333 StdDev: 1087.04 Min: 77 Median: 332.0500 Max: 24600 Percentiles: P50: 332.05 P75: 806.41 P99: 5715.37 P99.9: 8998.30 P99.99: 12280.66 ------------------------------------------------------ ( 76, 110 ] 2702 5.983% 5.983% # ( 110, 170 ] 9728 21.541% 27.524% #### ( 170, 250 ] 6907 15.294% 42.818% ### ( 250, 380 ] 5139 11.379% 54.197% ## ( 380, 580 ] 5677 12.571% 66.768% ### ( 580, 870 ] 4762 10.544% 77.312% ## ( 870, 1300 ] 3581 7.929% 85.242% ## ( 1300, 1900 ] 2180 4.827% 90.069% # ( 1900, 2900 ] 1736 3.844% 93.913% # ( 2900, 4400 ] 1840 4.074% 97.987% # ( 4400, 6600 ] 765 1.694% 99.681% ( 6600, 9900 ] 136 0.301% 99.982% ( 9900, 14000 ] 6 0.013% 99.996% ( 14000, 22000 ] 3 0.007% 100.002% ( 22000, 33000 ] 1 0.002% 100.004% ** DB Stats ** Uptime(secs): 12.2 total, 4.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 161.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.243 H:M:S, 34.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 219.27 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.764 H:M:S, 17.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-19:29:14 ... thread 0: (1000000,3000000) ops and (205601.2,177610.0) ops/second in (4.863785,16.890945) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 2.77 GB 0.0 2.6 0.0 2.6 5.3 2.8 0.0 1.9 101.3 209.8 26.11 17.86 48 0.544 2686K 3002 0.0 0.0 L1 17/17 1.46 GB 0.0 1.5 0.8 0.7 1.5 0.7 0.0 1.9 90.5 90.0 16.64 8.22 1 16.644 1529K 7955 0.0 0.0 L3 21/0 962.73 MB 1.0 4.1 3.1 0.9 4.0 3.1 0.0 1.3 113.6 112.9 36.54 19.04 15 2.436 706K 0 0.0 0.0 L4 175/0 9.73 GB 1.0 4.9 3.7 1.2 4.8 3.6 0.0 1.3 120.2 119.2 41.65 22.65 38 1.096 3791K 341 0.0 0.0 L5 1124/0 92.64 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1348/28 107.54 GB 0.0 13.0 7.6 5.4 15.7 10.3 3.6 5.7 110.0 132.8 120.94 67.76 102 1.186 8714K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.0 7.6 5.4 15.7 10.3 3.6 5.7 110.0 132.8 120.94 67.76 102 1.186 8714K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.0 7.6 5.4 12.9 7.5 0.0 0.0 124.6 123.9 106.81 59.92 63 1.695 8714K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 200.7 14.13 7.84 39 0.362 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.0 total, 16.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.69 GB write, 942.87 MB/s write, 13.00 GB read, 781.10 MB/s read, 120.9 seconds Interval compaction: 15.69 GB write, 951.02 MB/s write, 13.00 GB read, 787.85 MB/s read, 120.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 41, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 891885 Average: 15.0790 StdDev: 127.31 Min: 0 Median: 1.6830 Max: 16329 Percentiles: P50: 1.68 P75: 2.51 P99: 296.77 P99.9: 1508.97 P99.99: 3085.41 ------------------------------------------------------ [ 0, 1 ] 117143 13.134% 13.134% ### ( 1, 2 ] 481389 53.974% 67.109% ########### ( 2, 3 ] 137682 15.437% 82.546% ### ( 3, 4 ] 56515 6.337% 88.882% # ( 4, 6 ] 55016 6.169% 95.051% # ( 6, 10 ] 10870 1.219% 96.270% ( 10, 15 ] 2261 0.254% 96.523% ( 15, 22 ] 266 0.030% 96.553% ( 22, 34 ] 27 0.003% 96.556% ( 34, 51 ] 21 0.002% 96.558% ( 51, 76 ] 35 0.004% 96.562% ( 76, 110 ] 3648 0.409% 96.971% ( 110, 170 ] 11335 1.271% 98.242% ( 170, 250 ] 5607 0.629% 98.871% ( 250, 380 ] 3200 0.359% 99.230% ( 380, 580 ] 2869 0.322% 99.551% ( 580, 870 ] 1871 0.210% 99.761% ( 870, 1300 ] 1049 0.118% 99.879% ( 1300, 1900 ] 543 0.061% 99.940% ( 1900, 2900 ] 410 0.046% 99.986% ( 2900, 4400 ] 314 0.035% 100.021% ( 4400, 6600 ] 88 0.010% 100.031% ( 6600, 9900 ] 12 0.001% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 187875 Average: 7.8577 StdDev: 85.59 Min: 1 Median: 2.4984 Max: 6492 Percentiles: P50: 2.50 P75: 3.57 P99: 21.87 P99.9: 995.63 P99.99: 4204.09 ------------------------------------------------------ [ 0, 1 ] 2264 1.205% 1.205% ( 1, 2 ] 60765 32.343% 33.548% ###### ( 2, 3 ] 62016 33.009% 66.558% ####### ( 3, 4 ] 27976 14.891% 81.448% ### ( 4, 6 ] 24113 12.835% 94.283% ### ( 6, 10 ] 6503 3.461% 97.744% # ( 10, 15 ] 1772 0.943% 98.687% ( 15, 22 ] 598 0.318% 99.006% ( 22, 34 ] 55 0.029% 99.035% ( 34, 51 ] 7 0.004% 99.039% ( 51, 76 ] 6 0.003% 99.042% ( 76, 110 ] 181 0.096% 99.138% ( 110, 170 ] 585 0.311% 99.450% ( 170, 250 ] 319 0.170% 99.619% ( 250, 380 ] 190 0.101% 99.721% ( 380, 580 ] 188 0.100% 99.821% ( 580, 870 ] 124 0.066% 99.887% ( 870, 1300 ] 86 0.046% 99.932% ( 1300, 1900 ] 47 0.025% 99.957% ( 1900, 2900 ] 36 0.019% 99.977% ( 2900, 4400 ] 29 0.015% 99.992% ( 4400, 6600 ] 18 0.010% 100.002% ** Level 2 read latency histogram (micros): Count: 582066 Average: 11.3143 StdDev: 143.79 Min: 1 Median: 1.9695 Max: 15875 Percentiles: P50: 1.97 P75: 2.98 P99: 12.40 P99.9: 1611.60 P99.99: 2814.53 ------------------------------------------------------ [ 0, 1 ] 11705 2.011% 2.011% ( 1, 2 ] 288102 49.496% 51.507% ########## ( 2, 3 ] 139778 24.014% 75.522% ##### ( 3, 4 ] 57897 9.947% 85.468% ## ( 4, 6 ] 61272 10.527% 95.995% ## ( 6, 10 ] 15744 2.705% 98.700% # ( 10, 15 ] 3633 0.624% 99.324% ( 15, 22 ] 500 0.086% 99.410% ( 22, 34 ] 76 0.013% 99.423% ( 34, 51 ] 30 0.005% 99.428% ( 51, 76 ] 30 0.005% 99.433% ( 76, 110 ] 28 0.005% 99.438% ( 110, 170 ] 128 0.022% 99.460% ( 170, 250 ] 164 0.028% 99.488% ( 250, 380 ] 271 0.047% 99.535% ( 380, 580 ] 503 0.086% 99.621% ( 580, 870 ] 702 0.121% 99.742% ( 870, 1300 ] 681 0.117% 99.859% ( 1300, 1900 ] 462 0.079% 99.938% ( 1900, 2900 ] 330 0.057% 99.995% ( 2900, 4400 ] 311 0.053% 100.048% ( 4400, 6600 ] 87 0.015% 100.063% ( 6600, 9900 ] 19 0.003% 100.066% ( 9900, 14000 ] 1 0.000% 100.067% ( 14000, 22000 ] 1 0.000% 100.067% ** Level 3 read latency histogram (micros): Count: 1084105 Average: 9.3458 StdDev: 136.76 Min: 1 Median: 1.9715 Max: 17816 Percentiles: P50: 1.97 P75: 2.98 P99: 9.82 P99.9: 563.54 P99.99: 971.46 ------------------------------------------------------ [ 0, 1 ] 19889 1.835% 1.835% ( 1, 2 ] 537502 49.580% 51.415% ########## ( 2, 3 ] 260191 24.001% 75.415% ##### ( 3, 4 ] 115673 10.670% 86.085% ## ( 4, 6 ] 117832 10.869% 96.954% ## ( 6, 10 ] 23233 2.143% 99.097% ( 10, 15 ] 5284 0.487% 99.585% ( 15, 22 ] 621 0.057% 99.642% ( 22, 34 ] 69 0.006% 99.648% ( 34, 51 ] 75 0.007% 99.655% ( 51, 76 ] 86 0.008% 99.663% ( 76, 110 ] 310 0.029% 99.692% ( 110, 170 ] 818 0.075% 99.767% ( 170, 250 ] 427 0.039% 99.807% ( 250, 380 ] 430 0.040% 99.846% ( 380, 580 ] 633 0.058% 99.905% ( 580, 870 ] 753 0.069% 99.974% ( 870, 1300 ] 723 0.067% 100.041% ( 1300, 1900 ] 491 0.045% 100.086% ( 1900, 2900 ] 506 0.047% 100.133% ( 2900, 4400 ] 462 0.043% 100.176% ( 4400, 6600 ] 173 0.016% 100.191% ( 6600, 9900 ] 45 0.004% 100.196% ( 9900, 14000 ] 6 0.001% 100.196% ( 14000, 22000 ] 3 0.000% 100.196% ** Level 4 read latency histogram (micros): Count: 325283 Average: 36.6104 StdDev: 251.11 Min: 1 Median: 1.9842 Max: 31743 Percentiles: P50: 1.98 P75: 3.29 P99: 864.50 P99.9: 3289.62 P99.99: 4196.92 ------------------------------------------------------ [ 0, 1 ] 7927 2.437% 2.437% ( 1, 2 ] 157196 48.326% 50.763% ########## ( 2, 3 ] 69981 21.514% 72.277% #### ( 3, 4 ] 30998 9.530% 81.806% ## ( 4, 6 ] 30466 9.366% 91.172% ## ( 6, 10 ] 7464 2.295% 93.467% ( 10, 15 ] 1579 0.485% 93.952% ( 15, 22 ] 213 0.065% 94.018% ( 22, 34 ] 20 0.006% 94.024% ( 34, 51 ] 12 0.004% 94.028% ( 51, 76 ] 16 0.005% 94.033% ( 76, 110 ] 1915 0.589% 94.621% ( 110, 170 ] 6119 1.881% 96.502% ( 170, 250 ] 2926 0.900% 97.402% ( 250, 380 ] 1781 0.548% 97.949% ( 380, 580 ] 1875 0.576% 98.526% ( 580, 870 ] 1572 0.483% 99.009% ( 870, 1300 ] 1335 0.410% 99.420% ( 1300, 1900 ] 816 0.251% 99.670% ( 1900, 2900 ] 621 0.191% 99.861% ( 2900, 4400 ] 484 0.149% 100.010% ( 4400, 6600 ] 158 0.049% 100.059% ( 6600, 9900 ] 18 0.006% 100.064% ( 9900, 14000 ] 1 0.000% 100.065% ( 22000, 33000 ] 1 0.000% 100.065% ** Level 5 read latency histogram (micros): Count: 109274 Average: 421.3113 StdDev: 757.79 Min: 75 Median: 172.7327 Max: 24600 Percentiles: P50: 172.73 P75: 362.97 P99: 4241.93 P99.9: 7175.70 P99.99: 9562.06 ------------------------------------------------------ ( 51, 76 ] 5 0.005% 0.005% ( 76, 110 ] 13020 11.915% 11.920% ## ( 110, 170 ] 40964 37.487% 49.407% ####### ( 170, 250 ] 18970 17.360% 66.767% ### ( 250, 380 ] 10353 9.474% 76.241% ## ( 380, 580 ] 9524 8.716% 84.957% ## ( 580, 870 ] 5947 5.442% 90.399% # ( 870, 1300 ] 3772 3.452% 93.851% # ( 1300, 1900 ] 2217 2.029% 95.880% ( 1900, 2900 ] 1756 1.607% 97.487% ( 2900, 4400 ] 1848 1.691% 99.178% ( 4400, 6600 ] 765 0.700% 99.878% ( 6600, 9900 ] 136 0.124% 100.003% ( 9900, 14000 ] 6 0.005% 100.008% ( 14000, 22000 ] 3 0.003% 100.011% ( 22000, 33000 ] 1 0.001% 100.012% ** DB Stats ** Uptime(secs): 17.0 total, 4.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 173.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.518 H:M:S, 32.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 202.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.275 H:M:S, 26.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-19:29:18 ... thread 0: (1000000,4000000) ops and (271007.1,194355.1) ops/second in (3.689940,20.580885) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.75 GB 75.5 3.3 0.0 3.3 7.1 3.7 0.0 1.9 106.1 225.9 32.05 23.34 67 0.478 3454K 3764 0.0 0.0 L1 17/17 1.46 GB 0.0 1.5 0.8 0.7 1.5 0.7 0.0 1.9 90.5 90.0 16.64 8.22 1 16.644 1529K 7955 0.0 0.0 L3 21/0 962.73 MB 1.0 4.1 3.1 0.9 4.0 3.1 0.0 1.3 113.6 112.9 36.54 19.04 15 2.436 706K 0 0.0 0.0 L4 175/0 9.73 GB 1.0 4.9 3.7 1.2 4.8 3.6 0.0 1.3 120.2 119.2 41.65 22.65 38 1.096 3791K 341 0.0 0.0 L5 1124/0 92.64 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1355/32 108.53 GB 0.0 13.7 7.6 6.1 17.4 11.3 3.6 4.6 110.8 140.5 126.88 73.23 121 1.049 9482K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.7 7.6 6.1 17.4 11.3 3.6 4.6 110.8 140.5 126.88 73.23 121 1.049 9482K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.7 7.6 6.1 13.7 7.5 0.0 0.0 128.3 127.6 109.64 62.68 66 1.661 9482K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 222.8 17.25 10.55 55 0.314 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.6 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.41 GB write, 860.09 MB/s write, 13.74 GB read, 678.52 MB/s read, 126.9 seconds Interval compaction: 17.41 GB write, 866.19 MB/s write, 13.74 GB read, 683.34 MB/s read, 126.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 41, interval: 48 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1130510 Average: 15.3372 StdDev: 117.02 Min: 0 Median: 1.6403 Max: 16329 Percentiles: P50: 1.64 P75: 2.41 P99: 293.52 P99.9: 1229.71 P99.99: 2575.17 ------------------------------------------------------ [ 0, 1 ] 177721 15.720% 15.720% ### ( 1, 2 ] 605283 53.541% 69.261% ########### ( 2, 3 ] 157573 13.938% 83.199% ### ( 3, 4 ] 67289 5.952% 89.151% # ( 4, 6 ] 59848 5.294% 94.445% # ( 6, 10 ] 11952 1.057% 95.503% ( 10, 15 ] 2636 0.233% 95.736% ( 15, 22 ] 304 0.027% 95.763% ( 22, 34 ] 29 0.003% 95.765% ( 34, 51 ] 24 0.002% 95.767% ( 51, 76 ] 46 0.004% 95.771% ( 76, 110 ] 5763 0.510% 96.281% ( 110, 170 ] 19718 1.744% 98.025% ( 170, 250 ] 9449 0.836% 98.861% ( 250, 380 ] 4689 0.415% 99.276% ( 380, 580 ] 3969 0.351% 99.627% ( 580, 870 ] 2173 0.192% 99.819% ( 870, 1300 ] 1092 0.097% 99.916% ( 1300, 1900 ] 552 0.049% 99.965% ( 1900, 2900 ] 425 0.038% 100.002% ( 2900, 4400 ] 320 0.028% 100.031% ( 4400, 6600 ] 88 0.008% 100.038% ( 6600, 9900 ] 12 0.001% 100.039% ( 9900, 14000 ] 1 0.000% 100.039% ( 14000, 22000 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 196848 Average: 8.8199 StdDev: 85.50 Min: 1 Median: 2.5328 Max: 6492 Percentiles: P50: 2.53 P75: 3.65 P99: 143.80 P99.9: 963.58 P99.99: 4157.68 ------------------------------------------------------ [ 0, 1 ] 2369 1.203% 1.203% ( 1, 2 ] 62077 31.535% 32.739% ###### ( 2, 3 ] 63767 32.394% 65.133% ###### ( 3, 4 ] 29707 15.091% 80.224% ### ( 4, 6 ] 26451 13.437% 93.662% ### ( 6, 10 ] 6881 3.496% 97.157% # ( 10, 15 ] 1871 0.950% 98.108% ( 15, 22 ] 673 0.342% 98.450% ( 22, 34 ] 66 0.034% 98.483% ( 34, 51 ] 8 0.004% 98.487% ( 51, 76 ] 6 0.003% 98.490% ( 76, 110 ] 341 0.173% 98.663% ( 110, 170 ] 1176 0.597% 99.261% ( 170, 250 ] 548 0.278% 99.539% ( 250, 380 ] 283 0.144% 99.683% ( 380, 580 ] 262 0.133% 99.816% ( 580, 870 ] 146 0.074% 99.890% ( 870, 1300 ] 88 0.045% 99.935% ( 1300, 1900 ] 47 0.024% 99.959% ( 1900, 2900 ] 37 0.019% 99.978% ( 2900, 4400 ] 29 0.015% 99.992% ( 4400, 6600 ] 18 0.009% 100.002% ** Level 2 read latency histogram (micros): Count: 582066 Average: 11.3143 StdDev: 143.79 Min: 1 Median: 1.9695 Max: 15875 Percentiles: P50: 1.97 P75: 2.98 P99: 12.40 P99.9: 1611.60 P99.99: 2814.53 ------------------------------------------------------ [ 0, 1 ] 11705 2.011% 2.011% ( 1, 2 ] 288102 49.496% 51.507% ########## ( 2, 3 ] 139778 24.014% 75.522% ##### ( 3, 4 ] 57897 9.947% 85.468% ## ( 4, 6 ] 61272 10.527% 95.995% ## ( 6, 10 ] 15744 2.705% 98.700% # ( 10, 15 ] 3633 0.624% 99.324% ( 15, 22 ] 500 0.086% 99.410% ( 22, 34 ] 76 0.013% 99.423% ( 34, 51 ] 30 0.005% 99.428% ( 51, 76 ] 30 0.005% 99.433% ( 76, 110 ] 28 0.005% 99.438% ( 110, 170 ] 128 0.022% 99.460% ( 170, 250 ] 164 0.028% 99.488% ( 250, 380 ] 271 0.047% 99.535% ( 380, 580 ] 503 0.086% 99.621% ( 580, 870 ] 702 0.121% 99.742% ( 870, 1300 ] 681 0.117% 99.859% ( 1300, 1900 ] 462 0.079% 99.938% ( 1900, 2900 ] 330 0.057% 99.995% ( 2900, 4400 ] 311 0.053% 100.048% ( 4400, 6600 ] 87 0.015% 100.063% ( 6600, 9900 ] 19 0.003% 100.066% ( 9900, 14000 ] 1 0.000% 100.067% ( 14000, 22000 ] 1 0.000% 100.067% ** Level 3 read latency histogram (micros): Count: 1084920 Average: 9.4783 StdDev: 136.83 Min: 1 Median: 1.9722 Max: 17816 Percentiles: P50: 1.97 P75: 2.99 P99: 9.96 P99.9: 570.57 P99.99: 972.77 ------------------------------------------------------ [ 0, 1 ] 19889 1.833% 1.833% ( 1, 2 ] 537502 49.543% 51.376% ########## ( 2, 3 ] 260191 23.983% 75.359% ##### ( 3, 4 ] 115673 10.662% 86.021% ## ( 4, 6 ] 117832 10.861% 96.882% ## ( 6, 10 ] 23233 2.141% 99.023% ( 10, 15 ] 5284 0.487% 99.510% ( 15, 22 ] 621 0.057% 99.567% ( 22, 34 ] 69 0.006% 99.574% ( 34, 51 ] 75 0.007% 99.581% ( 51, 76 ] 86 0.008% 99.588% ( 76, 110 ] 453 0.042% 99.630% ( 110, 170 ] 1234 0.114% 99.744% ( 170, 250 ] 561 0.052% 99.796% ( 250, 380 ] 487 0.045% 99.841% ( 380, 580 ] 677 0.062% 99.903% ( 580, 870 ] 771 0.071% 99.974% ( 870, 1300 ] 726 0.067% 100.041% ( 1300, 1900 ] 491 0.045% 100.086% ( 1900, 2900 ] 506 0.047% 100.133% ( 2900, 4400 ] 462 0.043% 100.175% ( 4400, 6600 ] 173 0.016% 100.191% ( 6600, 9900 ] 45 0.004% 100.195% ( 9900, 14000 ] 6 0.001% 100.196% ( 14000, 22000 ] 3 0.000% 100.196% ** Level 4 read latency histogram (micros): Count: 333609 Average: 40.1551 StdDev: 249.85 Min: 1 Median: 2.0233 Max: 31743 Percentiles: P50: 2.02 P75: 3.48 P99: 854.81 P99.9: 3263.82 P99.99: 4194.34 ------------------------------------------------------ [ 0, 1 ] 7927 2.376% 2.376% ( 1, 2 ] 157243 47.134% 49.510% ######### ( 2, 3 ] 70130 21.022% 70.532% #### ( 3, 4 ] 31109 9.325% 79.857% ## ( 4, 6 ] 30606 9.174% 89.031% ## ( 6, 10 ] 7474 2.240% 91.271% ( 10, 15 ] 1582 0.474% 91.745% ( 15, 22 ] 213 0.064% 91.809% ( 22, 34 ] 20 0.006% 91.815% ( 34, 51 ] 12 0.004% 91.819% ( 51, 76 ] 16 0.005% 91.824% ( 76, 110 ] 3075 0.922% 92.745% ( 110, 170 ] 10111 3.031% 95.776% # ( 170, 250 ] 4442 1.331% 97.108% ( 250, 380 ] 2380 0.713% 97.821% ( 380, 580 ] 2321 0.696% 98.517% ( 580, 870 ] 1701 0.510% 99.027% ( 870, 1300 ] 1351 0.405% 99.432% ( 1300, 1900 ] 821 0.246% 99.678% ( 1900, 2900 ] 624 0.187% 99.865% ( 2900, 4400 ] 484 0.145% 100.010% ( 4400, 6600 ] 158 0.047% 100.057% ( 6600, 9900 ] 18 0.005% 100.063% ( 9900, 14000 ] 1 0.000% 100.063% ( 22000, 33000 ] 1 0.000% 100.063% ** Level 5 read latency histogram (micros): Count: 158579 Average: 349.0767 StdDev: 642.46 Min: 75 Median: 163.4495 Max: 24600 Percentiles: P50: 163.45 P75: 288.82 P99: 3842.43 P99.9: 6523.56 P99.99: 9418.15 ------------------------------------------------------ ( 51, 76 ] 6 0.004% 0.004% ( 76, 110 ] 20571 12.972% 12.976% ### ( 110, 170 ] 65908 41.562% 54.537% ######## ( 170, 250 ] 28289 17.839% 72.377% #### ( 250, 380 ] 13932 8.786% 81.162% ## ( 380, 580 ] 12425 7.835% 88.997% ## ( 580, 870 ] 6803 4.290% 93.287% # ( 870, 1300 ] 3892 2.454% 95.742% ( 1300, 1900 ] 2228 1.405% 97.147% ( 1900, 2900 ] 1775 1.119% 98.266% ( 2900, 4400 ] 1853 1.169% 99.434% ( 4400, 6600 ] 765 0.482% 99.917% ( 6600, 9900 ] 136 0.086% 100.003% ( 9900, 14000 ] 6 0.004% 100.006% ( 14000, 22000 ] 3 0.002% 100.008% ( 22000, 33000 ] 1 0.001% 100.009% ** DB Stats ** Uptime(secs): 20.7 total, 3.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 189.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.789 H:M:S, 27.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 266.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.271 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 227.968 micros/op 17521 ops/sec 60.154 seconds 1053996 operations; 17.0 MB/s (270999 of 270999 found) Microseconds per read: Count: 1053996 Average: 227.9700 StdDev: 654.15 Min: 2 Median: 166.3340 Max: 94559 Percentiles: P50: 166.33 P75: 227.60 P99: 972.93 P99.9: 10205.15 P99.99: 28503.78 ------------------------------------------------------ ( 1, 2 ] 11 0.001% 0.001% ( 2, 3 ] 48 0.005% 0.006% ( 3, 4 ] 74 0.007% 0.013% ( 4, 6 ] 101 0.010% 0.022% ( 6, 10 ] 612 0.058% 0.080% ( 10, 15 ] 6645 0.630% 0.711% ( 15, 22 ] 4341 0.412% 1.123% ( 22, 34 ] 9523 0.904% 2.026% ( 34, 51 ] 2200 0.209% 2.235% ( 51, 76 ] 297 0.028% 2.263% ( 76, 110 ] 29044 2.756% 5.019% # ( 110, 170 ] 504955 47.909% 52.927% ########## ( 170, 250 ] 323108 30.656% 83.583% ###### ( 250, 380 ] 107251 10.176% 93.758% ## ( 380, 580 ] 39640 3.761% 97.519% # ( 580, 870 ] 14352 1.362% 98.881% ( 870, 1300 ] 5239 0.497% 99.378% ( 1300, 1900 ] 2095 0.199% 99.577% ( 1900, 2900 ] 1502 0.143% 99.719% ( 2900, 4400 ] 1198 0.114% 99.833% ( 4400, 6600 ] 426 0.040% 99.873% ( 6600, 9900 ] 248 0.024% 99.897% ( 9900, 14000 ] 430 0.041% 99.938% ( 14000, 22000 ] 456 0.043% 99.981% ( 22000, 33000 ] 160 0.015% 99.996% ( 33000, 50000 ] 32 0.003% 99.999% ( 50000, 75000 ] 7 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 17711366 rocksdb.bloom.filter.full.positive COUNT : 1225961 rocksdb.bloom.filter.full.true.positive COUNT : 1053570 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 426 rocksdb.memtable.miss COUNT : 1053570 rocksdb.l0.hit COUNT : 42593 rocksdb.l1.hit COUNT : 14328 rocksdb.l2andup.hit COUNT : 996649 rocksdb.compaction.key.drop.new COUNT : 114941 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4512873 rocksdb.number.keys.read COUNT : 1053996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4657284936 rocksdb.bytes.read COUNT : 1053996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1569 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 42488846 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18585469587 rocksdb.compact.write.bytes COUNT : 18465336183 rocksdb.flush.write.bytes COUNT : 4624090941 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 39 rocksdb.number.superversion_acquires COUNT : 862 rocksdb.number.superversion_releases COUNT : 834 rocksdb.number.superversion_cleanups COUNT : 215 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 190 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4586722304 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1707008 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 22910205737 rocksdb.non.last.level.read.count COUNT : 5393475 rocksdb.block.checksum.compute.count COUNT : 5739384 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 165.631081 P95 : 444.728399 P99 : 971.053709 P100 : 94554.000000 COUNT : 1053996 SUM : 239496996 rocksdb.db.write.micros P50 : 1.566027 P95 : 4.600816 P99 : 10.839840 P100 : 820262.000000 COUNT : 4512873 SUM : 54009344 rocksdb.compaction.times.micros P50 : 1163571.428571 P95 : 5400000.000000 P99 : 16400000.000000 P100 : 16643895.000000 COUNT : 70 SUM : 117294349 rocksdb.compaction.times.cpu_micros P50 : 759615.384615 P95 : 3600000.000000 P99 : 7490000.000000 P100 : 8215593.000000 COUNT : 70 SUM : 70188790 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 788.205128 P95 : 146000.000000 P99 : 296800.000000 P100 : 365897.000000 COUNT : 64 SUM : 1274208 rocksdb.compaction.outfile.sync.micros P50 : 31625.000000 P95 : 305033.333333 P99 : 371940.000000 P100 : 940254.000000 COUNT : 193 SUM : 15741088 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 187.142857 P95 : 4352.272727 P99 : 6427.666667 P100 : 8378.000000 COUNT : 147 SUM : 144117 rocksdb.table.open.io.micros P50 : 9109.002169 P95 : 19867.307692 P99 : 25496.086957 P100 : 32887.000000 COUNT : 1569 SUM : 14545276 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.955869 P95 : 90.127960 P99 : 207.708701 P100 : 17819.000000 COUNT : 4500657 SUM : 79229647 rocksdb.read.block.get.micros P50 : 137.886608 P95 : 319.805837 P99 : 864.470836 P100 : 31749.000000 COUNT : 1237119 SUM : 204819421 rocksdb.write.raw.block.micros P50 : 0.539690 P95 : 1.436296 P99 : 3.714503 P100 : 34389.000000 COUNT : 5592342 SUM : 15695995 rocksdb.numfiles.in.singlecompaction P50 : 2.428571 P95 : 5.800000 P99 : 23.920000 P100 : 28.000000 COUNT : 84 SUM : 293 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.575727 P95 : 2040.696311 P99 : 2729.005141 P100 : 820093.000000 COUNT : 190782 SUM : 42505762 rocksdb.sst.read.micros P50 : 2.368420 P95 : 168.875301 P99 : 465.541045 P100 : 31743.000000 COUNT : 5393475 SUM : 266602336 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1053996 SUM : 1053996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4512873 SUM : 4657284936 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 222244.897959 P95 : 850333.333333 P99 : 1080725.000000 P100 : 1080725.000000 COUNT : 64 SUM : 19105683 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 224 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0