[2024-11-15 10:01:34.220437] Starting SPDK v25.01-pre git sha1 41bc9c125 / DPDK 24.03.0 initialization... [2024-11-15 10:01:34.220559] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid810294 ] Set seed to 1731661294217835 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-15 10:01:34.359182] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-15 10:01:34.462424] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-15 10:01:34.462485] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 810294' to capture a snapshot of events at runtime. [2024-11-15 10:01:34.462497] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-15 10:01:34.462510] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-15 10:01:34.462520] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid810294 for offline analysis/debug. [2024-11-15 10:01:34.463731] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 15 10:01:37 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/15-10:01:44 ... thread 0: (1000000,1000000) ops and (148550.3,148550.3) ops/second in (6.731728,6.731728) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.32 GB 56.4 0.3 0.0 0.3 1.2 0.9 0.0 1.4 37.9 143.7 8.30 4.07 12 0.692 319K 1795 0.0 0.0 L1 4/4 251.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/4 1.21 GB 1.0 1.9 1.5 0.4 1.8 1.5 0.0 1.2 107.2 105.2 17.82 9.87 8 2.227 1596K 4970 0.0 0.0 L4 152/16 10.88 GB 1.0 3.7 1.7 2.0 3.4 1.5 0.2 2.0 127.6 118.7 29.70 17.70 17 1.747 827K 0 0.0 0.0 L5 132/0 10.27 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 323/33 23.94 GB 0.0 5.9 3.2 2.7 6.4 3.8 1.2 7.5 107.8 118.1 55.82 31.64 37 1.509 2743K 6765 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 3.2 2.7 6.4 3.8 1.2 7.5 107.8 118.1 55.82 31.64 37 1.509 2743K 6765 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 3.2 2.7 5.6 2.9 0.0 0.0 121.1 115.1 49.66 28.96 26 1.910 2743K 6765 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 142.8 6.16 2.68 11 0.560 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.8 total, 6.7 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.44 GB write, 969.30 MB/s write, 5.87 GB read, 884.25 MB/s read, 55.8 seconds Interval compaction: 6.44 GB write, 979.21 MB/s write, 5.87 GB read, 893.29 MB/s read, 55.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 192513 Average: 48.2299 StdDev: 428.74 Min: 1 Median: 2.2576 Max: 51425 Percentiles: P50: 2.26 P75: 3.30 P99: 1057.59 P99.9: 4349.09 P99.99: 6760.30 ------------------------------------------------------ [ 0, 1 ] 2949 1.532% 1.532% ( 1, 2 ] 78718 40.890% 42.422% ######## ( 2, 3 ] 56650 29.427% 71.848% ###### ( 3, 4 ] 20016 10.397% 82.245% ## ( 4, 6 ] 20029 10.404% 92.649% ## ( 6, 10 ] 5254 2.729% 95.378% # ( 10, 15 ] 976 0.507% 95.885% ( 15, 22 ] 131 0.068% 95.954% ( 22, 34 ] 10 0.005% 95.959% ( 34, 51 ] 24 0.012% 95.971% ( 51, 76 ] 19 0.010% 95.981% ( 76, 110 ] 8 0.004% 95.985% ( 110, 170 ] 43 0.022% 96.008% ( 170, 250 ] 289 0.150% 96.158% ( 250, 380 ] 935 0.486% 96.643% ( 380, 580 ] 2002 1.040% 97.683% ( 580, 870 ] 2097 1.089% 98.773% ( 870, 1300 ] 1006 0.523% 99.295% ( 1300, 1900 ] 312 0.162% 99.457% ( 1900, 2900 ] 355 0.184% 99.642% ( 2900, 4400 ] 516 0.268% 99.910% ( 4400, 6600 ] 154 0.080% 99.990% ( 6600, 9900 ] 36 0.019% 100.008% ( 9900, 14000 ] 8 0.004% 100.012% ( 14000, 22000 ] 4 0.002% 100.015% ( 22000, 33000 ] 9 0.005% 100.019% ( 33000, 50000 ] 4 0.002% 100.021% ( 50000, 75000 ] 1 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 293 Average: 1261.8259 StdDev: 1973.58 Min: 122 Median: 667.0000 Max: 26541 Percentiles: P50: 667.00 P75: 1231.59 P99: 6715.50 P99.9: 26541.00 P99.99: 26541.00 ------------------------------------------------------ ( 110, 170 ] 1 0.341% 0.341% ( 170, 250 ] 11 3.754% 4.096% # ( 250, 380 ] 41 13.993% 18.089% ### ( 380, 580 ] 74 25.256% 43.345% ##### ( 580, 870 ] 65 22.184% 65.529% #### ( 870, 1300 ] 33 11.263% 76.792% ## ( 1300, 1900 ] 16 5.461% 82.253% # ( 1900, 2900 ] 17 5.802% 88.055% # ( 2900, 4400 ] 21 7.167% 95.222% # ( 4400, 6600 ] 11 3.754% 98.976% # ( 6600, 9900 ] 2 0.683% 99.659% ( 22000, 33000 ] 1 0.341% 100.000% ** Level 2 read latency histogram (micros): Count: 289280 Average: 14.5423 StdDev: 274.16 Min: 1 Median: 2.2697 Max: 36088 Percentiles: P50: 2.27 P75: 3.23 P99: 12.42 P99.9: 1195.92 P99.99: 2474.52 ------------------------------------------------------ [ 0, 1 ] 2588 0.895% 0.895% ( 1, 2 ] 118134 40.837% 41.732% ######## ( 2, 3 ] 88674 30.653% 72.385% ###### ( 3, 4 ] 32929 11.383% 83.768% ## ( 4, 6 ] 34494 11.924% 95.692% ## ( 6, 10 ] 8607 2.975% 98.668% # ( 10, 15 ] 1987 0.687% 99.355% ( 15, 22 ] 368 0.127% 99.482% ( 22, 34 ] 48 0.017% 99.498% ( 34, 51 ] 56 0.019% 99.518% ( 51, 76 ] 38 0.013% 99.531% ( 76, 110 ] 21 0.007% 99.538% ( 110, 170 ] 30 0.010% 99.549% ( 170, 250 ] 38 0.013% 99.562% ( 250, 380 ] 166 0.057% 99.619% ( 380, 580 ] 334 0.115% 99.735% ( 580, 870 ] 315 0.109% 99.843% ( 870, 1300 ] 216 0.075% 99.918% ( 1300, 1900 ] 115 0.040% 99.958% ( 1900, 2900 ] 162 0.056% 100.014% ( 2900, 4400 ] 224 0.077% 100.091% ( 4400, 6600 ] 84 0.029% 100.120% ( 6600, 9900 ] 31 0.011% 100.131% ( 9900, 14000 ] 7 0.002% 100.133% ( 14000, 22000 ] 11 0.004% 100.137% ( 22000, 33000 ] 6 0.002% 100.139% ( 33000, 50000 ] 4 0.001% 100.141% ** Level 3 read latency histogram (micros): Count: 441359 Average: 15.5823 StdDev: 258.87 Min: 1 Median: 2.3389 Max: 47396 Percentiles: P50: 2.34 P75: 3.30 P99: 14.81 P99.9: 1280.87 P99.99: 2408.85 ------------------------------------------------------ [ 0, 1 ] 2985 0.676% 0.676% ( 1, 2 ] 168994 38.289% 38.966% ######## ( 2, 3 ] 143691 32.556% 71.522% ####### ( 3, 4 ] 51448 11.657% 83.179% ## ( 4, 6 ] 54814 12.419% 95.598% ## ( 6, 10 ] 12743 2.887% 98.486% # ( 10, 15 ] 2359 0.534% 99.020% ( 15, 22 ] 296 0.067% 99.087% ( 22, 34 ] 51 0.012% 99.099% ( 34, 51 ] 93 0.021% 99.120% ( 51, 76 ] 105 0.024% 99.144% ( 76, 110 ] 46 0.010% 99.154% ( 110, 170 ] 49 0.011% 99.165% ( 170, 250 ] 155 0.035% 99.200% ( 250, 380 ] 483 0.109% 99.310% ( 380, 580 ] 1011 0.229% 99.539% ( 580, 870 ] 1051 0.238% 99.777% ( 870, 1300 ] 570 0.129% 99.906% ( 1300, 1900 ] 236 0.053% 99.959% ( 1900, 2900 ] 267 0.060% 100.020% ( 2900, 4400 ] 296 0.067% 100.087% ( 4400, 6600 ] 104 0.024% 100.111% ( 6600, 9900 ] 32 0.007% 100.118% ( 9900, 14000 ] 7 0.002% 100.119% ( 14000, 22000 ] 8 0.002% 100.121% ( 22000, 33000 ] 4 0.001% 100.122% ( 33000, 50000 ] 7 0.002% 100.124% ** Level 4 read latency histogram (micros): Count: 746660 Average: 24.9567 StdDev: 325.27 Min: 1 Median: 2.3429 Max: 51412 Percentiles: P50: 2.34 P75: 3.36 P99: 492.59 P99.9: 1261.20 P99.99: 1788.47 ------------------------------------------------------ [ 0, 1 ] 5231 0.701% 0.701% ( 1, 2 ] 287231 38.469% 39.169% ######## ( 2, 3 ] 235845 31.587% 70.756% ###### ( 3, 4 ] 89170 11.943% 82.699% ## ( 4, 6 ] 91669 12.277% 94.976% ## ( 6, 10 ] 20606 2.760% 97.736% # ( 10, 15 ] 4122 0.552% 98.288% ( 15, 22 ] 545 0.073% 98.361% ( 22, 34 ] 86 0.012% 98.372% ( 34, 51 ] 192 0.026% 98.398% ( 51, 76 ] 161 0.022% 98.419% ( 76, 110 ] 45 0.006% 98.425% ( 110, 170 ] 136 0.018% 98.444% ( 170, 250 ] 520 0.070% 98.513% ( 250, 380 ] 1624 0.218% 98.731% ( 380, 580 ] 3573 0.479% 99.209% ( 580, 870 ] 3579 0.479% 99.689% ( 870, 1300 ] 1736 0.233% 99.921% ( 1300, 1900 ] 633 0.085% 100.006% ( 1900, 2900 ] 682 0.091% 100.097% ( 2900, 4400 ] 955 0.128% 100.225% ( 4400, 6600 ] 278 0.037% 100.262% ( 6600, 9900 ] 72 0.010% 100.272% ( 9900, 14000 ] 16 0.002% 100.274% ( 14000, 22000 ] 34 0.005% 100.279% ( 22000, 33000 ] 16 0.002% 100.281% ( 33000, 50000 ] 11 0.001% 100.282% ( 50000, 75000 ] 2 0.000% 100.283% ** Level 5 read latency histogram (micros): Count: 8490 Average: 1049.4259 StdDev: 1761.79 Min: 117 Median: 653.5127 Max: 47444 Percentiles: P50: 653.51 P75: 993.46 P99: 6208.29 P99.9: 28435.00 P99.99: 47444.00 ------------------------------------------------------ ( 110, 170 ] 58 0.683% 0.683% ( 170, 250 ] 306 3.604% 4.287% # ( 250, 380 ] 1046 12.320% 16.608% ## ( 380, 580 ] 2218 26.125% 42.733% ##### ( 580, 870 ] 2434 28.669% 71.402% ###### ( 870, 1300 ] 1064 12.532% 83.934% ### ( 1300, 1900 ] 336 3.958% 87.892% # ( 1900, 2900 ] 362 4.264% 92.155% # ( 2900, 4400 ] 480 5.654% 97.809% # ( 4400, 6600 ] 123 1.449% 99.258% ( 6600, 9900 ] 43 0.506% 99.764% ( 9900, 14000 ] 1 0.012% 99.776% ( 14000, 22000 ] 7 0.082% 99.859% ( 22000, 33000 ] 6 0.071% 99.929% ( 33000, 50000 ] 6 0.071% 100.000% ** DB Stats ** Uptime(secs): 6.8 total, 6.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 144.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.805 H:M:S, 26.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 146.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.805 H:M:S, 26.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/15-10:01:47 ... thread 0: (1000000,2000000) ops and (263150.0,189900.3) ops/second in (3.800114,10.531842) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 2.30 GB 162.7 1.4 0.0 1.4 3.2 1.8 0.0 1.8 80.3 184.6 18.02 11.50 32 0.563 1468K 7811 0.0 0.0 L1 4/4 251.66 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 980.31 MB 1.0 1.9 1.5 0.4 1.8 1.5 0.0 1.2 107.2 105.2 17.82 9.87 8 2.227 1596K 4970 0.0 0.0 L4 138/0 9.53 GB 1.0 5.3 2.0 3.3 4.8 1.5 0.2 2.4 139.1 125.6 39.09 24.58 21 1.861 1093K 0 0.0 0.0 L5 152/0 11.63 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 329/13 24.66 GB 0.0 8.6 3.5 5.1 9.9 4.8 2.5 5.4 117.4 135.0 74.93 45.96 61 1.228 4158K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 3.5 5.1 9.9 4.8 2.5 5.4 117.4 135.0 74.93 45.96 61 1.228 4158K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 3.5 5.1 8.0 2.9 0.0 0.0 134.4 125.7 65.44 40.43 34 1.925 4158K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 199.0 9.48 5.52 27 0.351 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.6 total, 10.5 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.87 GB write, 953.73 MB/s write, 8.59 GB read, 829.45 MB/s read, 74.9 seconds Interval compaction: 9.87 GB write, 959.97 MB/s write, 8.59 GB read, 834.87 MB/s read, 74.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 548201 Average: 27.7905 StdDev: 265.75 Min: 1 Median: 1.7883 Max: 51425 Percentiles: P50: 1.79 P75: 2.71 P99: 538.54 P99.9: 2584.77 P99.99: 3944.85 ------------------------------------------------------ [ 0, 1 ] 51731 9.437% 9.437% ## ( 1, 2 ] 282092 51.458% 60.894% ########## ( 2, 3 ] 109624 19.997% 80.891% #### ( 3, 4 ] 35479 6.472% 87.363% # ( 4, 6 ] 30135 5.497% 92.860% # ( 6, 10 ] 8977 1.638% 94.498% ( 10, 15 ] 1649 0.301% 94.799% ( 15, 22 ] 226 0.041% 94.840% ( 22, 34 ] 42 0.008% 94.848% ( 34, 51 ] 30 0.005% 94.853% ( 51, 76 ] 22 0.004% 94.857% ( 76, 110 ] 204 0.037% 94.894% ( 110, 170 ] 4592 0.838% 95.732% ( 170, 250 ] 10613 1.936% 97.668% ( 250, 380 ] 4444 0.811% 98.478% ( 380, 580 ] 3608 0.658% 99.137% ( 580, 870 ] 2523 0.460% 99.597% ( 870, 1300 ] 1066 0.194% 99.791% ( 1300, 1900 ] 327 0.060% 99.851% ( 1900, 2900 ] 394 0.072% 99.923% ( 2900, 4400 ] 530 0.097% 100.020% ( 4400, 6600 ] 154 0.028% 100.048% ( 6600, 9900 ] 36 0.007% 100.054% ( 9900, 14000 ] 11 0.002% 100.056% ( 14000, 22000 ] 5 0.001% 100.057% ( 22000, 33000 ] 10 0.002% 100.059% ( 33000, 50000 ] 4 0.001% 100.060% ( 50000, 75000 ] 1 0.000% 100.060% ** Level 1 read latency histogram (micros): Count: 12525 Average: 45.5360 StdDev: 361.68 Min: 1 Median: 3.0994 Max: 26541 Percentiles: P50: 3.10 P75: 4.90 P99: 784.41 P99.9: 4695.00 P99.99: 9483.37 ------------------------------------------------------ [ 0, 1 ] 104 0.830% 0.830% ( 1, 2 ] 2616 20.886% 21.717% #### ( 2, 3 ] 3322 26.523% 48.240% ##### ( 3, 4 ] 2218 17.709% 65.948% #### ( 4, 6 ] 2528 20.184% 86.132% #### ( 6, 10 ] 474 3.784% 89.916% # ( 10, 15 ] 200 1.597% 91.513% ( 15, 22 ] 76 0.607% 92.120% ( 22, 34 ] 15 0.120% 92.240% ( 34, 51 ] 3 0.024% 92.263% ( 76, 110 ] 8 0.064% 92.327% ( 110, 170 ] 181 1.445% 93.772% ( 170, 250 ] 357 2.850% 96.623% # ( 250, 380 ] 131 1.046% 97.669% ( 380, 580 ] 116 0.926% 98.595% ( 580, 870 ] 72 0.575% 99.170% ( 870, 1300 ] 34 0.271% 99.441% ( 1300, 1900 ] 16 0.128% 99.569% ( 1900, 2900 ] 17 0.136% 99.705% ( 2900, 4400 ] 23 0.184% 99.888% ( 4400, 6600 ] 11 0.088% 99.976% ( 6600, 9900 ] 2 0.016% 99.992% ( 22000, 33000 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 289280 Average: 14.5423 StdDev: 274.16 Min: 1 Median: 2.2697 Max: 36088 Percentiles: P50: 2.27 P75: 3.23 P99: 12.42 P99.9: 1195.92 P99.99: 2474.52 ------------------------------------------------------ [ 0, 1 ] 2588 0.895% 0.895% ( 1, 2 ] 118134 40.837% 41.732% ######## ( 2, 3 ] 88674 30.653% 72.385% ###### ( 3, 4 ] 32929 11.383% 83.768% ## ( 4, 6 ] 34494 11.924% 95.692% ## ( 6, 10 ] 8607 2.975% 98.668% # ( 10, 15 ] 1987 0.687% 99.355% ( 15, 22 ] 368 0.127% 99.482% ( 22, 34 ] 48 0.017% 99.498% ( 34, 51 ] 56 0.019% 99.518% ( 51, 76 ] 38 0.013% 99.531% ( 76, 110 ] 21 0.007% 99.538% ( 110, 170 ] 30 0.010% 99.549% ( 170, 250 ] 38 0.013% 99.562% ( 250, 380 ] 166 0.057% 99.619% ( 380, 580 ] 334 0.115% 99.735% ( 580, 870 ] 315 0.109% 99.843% ( 870, 1300 ] 216 0.075% 99.918% ( 1300, 1900 ] 115 0.040% 99.958% ( 1900, 2900 ] 162 0.056% 100.014% ( 2900, 4400 ] 224 0.077% 100.091% ( 4400, 6600 ] 84 0.029% 100.120% ( 6600, 9900 ] 31 0.011% 100.131% ( 9900, 14000 ] 7 0.002% 100.133% ( 14000, 22000 ] 11 0.004% 100.137% ( 22000, 33000 ] 6 0.002% 100.139% ( 33000, 50000 ] 4 0.001% 100.141% ** Level 3 read latency histogram (micros): Count: 466430 Average: 16.4167 StdDev: 252.78 Min: 1 Median: 2.3307 Max: 47396 Percentiles: P50: 2.33 P75: 3.31 P99: 231.72 P99.9: 1262.97 P99.99: 2393.91 ------------------------------------------------------ [ 0, 1 ] 3498 0.750% 0.750% ( 1, 2 ] 180191 38.632% 39.382% ######## ( 2, 3 ] 149762 32.108% 71.490% ###### ( 3, 4 ] 53439 11.457% 82.947% ## ( 4, 6 ] 56492 12.112% 95.059% ## ( 6, 10 ] 13271 2.845% 97.904% # ( 10, 15 ] 2412 0.517% 98.421% ( 15, 22 ] 304 0.065% 98.486% ( 22, 34 ] 51 0.011% 98.497% ( 34, 51 ] 95 0.020% 98.517% ( 51, 76 ] 105 0.023% 98.540% ( 76, 110 ] 68 0.015% 98.555% ( 110, 170 ] 743 0.159% 98.714% ( 170, 250 ] 1730 0.371% 99.085% ( 250, 380 ] 961 0.206% 99.291% ( 380, 580 ] 1215 0.260% 99.551% ( 580, 870 ] 1102 0.236% 99.788% ( 870, 1300 ] 574 0.123% 99.911% ( 1300, 1900 ] 237 0.051% 99.961% ( 1900, 2900 ] 270 0.058% 100.019% ( 2900, 4400 ] 298 0.064% 100.083% ( 4400, 6600 ] 104 0.022% 100.105% ( 6600, 9900 ] 32 0.007% 100.112% ( 9900, 14000 ] 7 0.002% 100.114% ( 14000, 22000 ] 8 0.002% 100.116% ( 22000, 33000 ] 4 0.001% 100.116% ( 33000, 50000 ] 7 0.002% 100.118% ** Level 4 read latency histogram (micros): Count: 888607 Average: 27.9710 StdDev: 305.59 Min: 0 Median: 2.3442 Max: 51412 Percentiles: P50: 2.34 P75: 3.44 P99: 481.03 P99.9: 1200.79 P99.99: 1657.16 ------------------------------------------------------ [ 0, 1 ] 6694 0.753% 0.753% ( 1, 2 ] 344388 38.756% 39.509% ######## ( 2, 3 ] 270843 30.480% 69.989% ###### ( 3, 4 ] 100208 11.277% 81.266% ## ( 4, 6 ] 101384 11.409% 92.675% ## ( 6, 10 ] 23637 2.660% 95.335% # ( 10, 15 ] 4521 0.509% 95.844% ( 15, 22 ] 590 0.066% 95.910% ( 22, 34 ] 91 0.010% 95.920% ( 34, 51 ] 198 0.022% 95.943% ( 51, 76 ] 167 0.019% 95.962% ( 76, 110 ] 315 0.035% 95.997% ( 110, 170 ] 5827 0.656% 96.653% ( 170, 250 ] 12963 1.459% 98.112% ( 250, 380 ] 5253 0.591% 98.703% ( 380, 580 ] 5230 0.589% 99.291% ( 580, 870 ] 4027 0.453% 99.744% ( 870, 1300 ] 1797 0.202% 99.947% ( 1300, 1900 ] 647 0.073% 100.019% ( 1900, 2900 ] 703 0.079% 100.099% ( 2900, 4400 ] 978 0.110% 100.209% ( 4400, 6600 ] 279 0.031% 100.240% ( 6600, 9900 ] 73 0.008% 100.248% ( 9900, 14000 ] 19 0.002% 100.250% ( 14000, 22000 ] 35 0.004% 100.254% ( 22000, 33000 ] 18 0.002% 100.256% ( 33000, 50000 ] 11 0.001% 100.258% ( 50000, 75000 ] 2 0.000% 100.258% ** Level 5 read latency histogram (micros): Count: 27122 Average: 489.9211 StdDev: 1072.22 Min: 92 Median: 241.5164 Max: 47444 Percentiles: P50: 241.52 P75: 488.56 P99: 4141.66 P99.9: 9430.17 P99.99: 42315.43 ------------------------------------------------------ ( 76, 110 ] 184 0.678% 0.678% ( 110, 170 ] 4416 16.282% 16.960% ### ( 170, 250 ] 10024 36.959% 53.919% ####### ( 250, 380 ] 3873 14.280% 68.199% ### ( 380, 580 ] 3398 12.529% 80.728% ### ( 580, 870 ] 2730 10.066% 90.793% ## ( 870, 1300 ] 1091 4.023% 94.816% # ( 1300, 1900 ] 348 1.283% 96.099% ( 1900, 2900 ] 382 1.408% 97.508% ( 2900, 4400 ] 489 1.803% 99.311% ( 4400, 6600 ] 123 0.454% 99.764% ( 6600, 9900 ] 43 0.159% 99.923% ( 9900, 14000 ] 1 0.004% 99.926% ( 14000, 22000 ] 7 0.026% 99.952% ( 22000, 33000 ] 7 0.026% 99.978% ( 33000, 50000 ] 6 0.022% 100.000% ** DB Stats ** Uptime(secs): 10.6 total, 3.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 185.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.805 H:M:S, 17.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 259.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/15-10:01:52 ... thread 0: (1000000,3000000) ops and (248519.3,206105.2) ops/second in (4.023833,14.555675) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/16 2.81 GB 0.0 2.4 0.0 2.4 5.2 2.8 0.0 1.8 97.6 212.1 25.14 18.18 52 0.483 2490K 12K 0.0 0.0 L1 9/9 715.31 MB 0.0 0.7 0.5 0.2 0.7 0.5 0.0 1.5 53.0 52.3 13.67 4.84 1 13.667 736K 9779 0.0 0.0 L3 18/0 980.31 MB 1.0 1.9 1.5 0.4 1.8 1.5 0.0 1.2 107.2 105.2 17.82 9.87 8 2.227 1596K 4970 0.0 0.0 L4 138/0 9.53 GB 1.0 5.3 2.0 3.3 4.8 1.5 0.2 2.4 139.1 125.6 39.09 24.58 21 1.861 1093K 0 0.0 0.0 L5 152/0 11.63 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 333/25 25.63 GB 0.0 10.3 3.9 6.3 12.5 6.2 2.5 4.4 110.0 134.1 95.72 57.48 82 1.167 5916K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.3 3.9 6.3 12.5 6.2 2.5 4.4 110.0 134.1 95.72 57.48 82 1.167 5916K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.3 3.9 6.3 9.7 3.4 0.0 0.0 126.7 119.7 83.09 49.17 39 2.130 5916K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 229.1 12.63 8.31 43 0.294 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.6 total, 14.6 interval Flush(GB): cumulative 2.826, interval 2.826 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.53 GB write, 877.56 MB/s write, 10.28 GB read, 719.65 MB/s read, 95.7 seconds Interval compaction: 12.53 GB write, 881.71 MB/s write, 10.28 GB read, 723.05 MB/s read, 95.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 16, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 782083 Average: 25.3710 StdDev: 225.03 Min: 0 Median: 1.7199 Max: 51425 Percentiles: P50: 1.72 P75: 2.59 P99: 434.29 P99.9: 1767.12 P99.99: 3567.33 ------------------------------------------------------ [ 0, 1 ] 93945 12.012% 12.012% ## ( 1, 2 ] 412677 52.766% 64.779% ########### ( 2, 3 ] 135422 17.316% 82.094% ### ( 3, 4 ] 43003 5.499% 87.593% # ( 4, 6 ] 35866 4.586% 92.179% # ( 6, 10 ] 10237 1.309% 93.488% ( 10, 15 ] 1903 0.243% 93.731% ( 15, 22 ] 269 0.034% 93.765% ( 22, 34 ] 66 0.008% 93.774% ( 34, 51 ] 31 0.004% 93.778% ( 51, 76 ] 22 0.003% 93.780% ( 76, 110 ] 554 0.071% 93.851% ( 110, 170 ] 11035 1.411% 95.262% ( 170, 250 ] 21630 2.766% 98.028% # ( 250, 380 ] 6459 0.826% 98.854% ( 380, 580 ] 4211 0.538% 99.392% ( 580, 870 ] 2628 0.336% 99.728% ( 870, 1300 ] 1086 0.139% 99.867% ( 1300, 1900 ] 330 0.042% 99.909% ( 1900, 2900 ] 395 0.051% 99.960% ( 2900, 4400 ] 530 0.068% 100.028% ( 4400, 6600 ] 154 0.020% 100.047% ( 6600, 9900 ] 36 0.005% 100.052% ( 9900, 14000 ] 11 0.001% 100.053% ( 14000, 22000 ] 5 0.001% 100.054% ( 22000, 33000 ] 10 0.001% 100.055% ( 33000, 50000 ] 4 0.001% 100.056% ( 50000, 75000 ] 1 0.000% 100.056% ** Level 1 read latency histogram (micros): Count: 66900 Average: 16.4206 StdDev: 160.92 Min: 1 Median: 2.9375 Max: 26541 Percentiles: P50: 2.94 P75: 4.32 P99: 248.61 P99.9: 1436.67 P99.99: 5662.00 ------------------------------------------------------ [ 0, 1 ] 578 0.864% 0.864% ( 1, 2 ] 13749 20.552% 21.416% #### ( 2, 3 ] 20398 30.490% 51.906% ###### ( 3, 4 ] 13509 20.193% 72.099% #### ( 4, 6 ] 12269 18.339% 90.438% #### ( 6, 10 ] 2565 3.834% 94.272% # ( 10, 15 ] 868 1.297% 95.570% ( 15, 22 ] 320 0.478% 96.048% ( 22, 34 ] 81 0.121% 96.169% ( 34, 51 ] 18 0.027% 96.196% ( 51, 76 ] 1 0.001% 96.197% ( 76, 110 ] 39 0.058% 96.256% ( 110, 170 ] 650 0.972% 97.227% ( 170, 250 ] 1207 1.804% 99.031% ( 250, 380 ] 298 0.445% 99.477% ( 380, 580 ] 156 0.233% 99.710% ( 580, 870 ] 83 0.124% 99.834% ( 870, 1300 ] 40 0.060% 99.894% ( 1300, 1900 ] 18 0.027% 99.921% ( 1900, 2900 ] 17 0.025% 99.946% ( 2900, 4400 ] 23 0.034% 99.981% ( 4400, 6600 ] 11 0.016% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ( 22000, 33000 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 289280 Average: 14.5423 StdDev: 274.16 Min: 1 Median: 2.2697 Max: 36088 Percentiles: P50: 2.27 P75: 3.23 P99: 12.42 P99.9: 1195.92 P99.99: 2474.52 ------------------------------------------------------ [ 0, 1 ] 2588 0.895% 0.895% ( 1, 2 ] 118134 40.837% 41.732% ######## ( 2, 3 ] 88674 30.653% 72.385% ###### ( 3, 4 ] 32929 11.383% 83.768% ## ( 4, 6 ] 34494 11.924% 95.692% ## ( 6, 10 ] 8607 2.975% 98.668% # ( 10, 15 ] 1987 0.687% 99.355% ( 15, 22 ] 368 0.127% 99.482% ( 22, 34 ] 48 0.017% 99.498% ( 34, 51 ] 56 0.019% 99.518% ( 51, 76 ] 38 0.013% 99.531% ( 76, 110 ] 21 0.007% 99.538% ( 110, 170 ] 30 0.010% 99.549% ( 170, 250 ] 38 0.013% 99.562% ( 250, 380 ] 166 0.057% 99.619% ( 380, 580 ] 334 0.115% 99.735% ( 580, 870 ] 315 0.109% 99.843% ( 870, 1300 ] 216 0.075% 99.918% ( 1300, 1900 ] 115 0.040% 99.958% ( 1900, 2900 ] 162 0.056% 100.014% ( 2900, 4400 ] 224 0.077% 100.091% ( 4400, 6600 ] 84 0.029% 100.120% ( 6600, 9900 ] 31 0.011% 100.131% ( 9900, 14000 ] 7 0.002% 100.133% ( 14000, 22000 ] 11 0.004% 100.137% ( 22000, 33000 ] 6 0.002% 100.139% ( 33000, 50000 ] 4 0.001% 100.141% ** Level 3 read latency histogram (micros): Count: 470088 Average: 17.8457 StdDev: 252.39 Min: 1 Median: 2.3429 Max: 47396 Percentiles: P50: 2.34 P75: 3.36 P99: 253.52 P99.9: 1261.05 P99.99: 2392.56 ------------------------------------------------------ [ 0, 1 ] 3498 0.744% 0.744% ( 1, 2 ] 180191 38.331% 39.075% ######## ( 2, 3 ] 149762 31.858% 70.934% ###### ( 3, 4 ] 53439 11.368% 82.302% ## ( 4, 6 ] 56492 12.017% 94.319% ## ( 6, 10 ] 13271 2.823% 97.142% # ( 10, 15 ] 2412 0.513% 97.655% ( 15, 22 ] 304 0.065% 97.720% ( 22, 34 ] 51 0.011% 97.731% ( 34, 51 ] 95 0.020% 97.751% ( 51, 76 ] 105 0.022% 97.773% ( 76, 110 ] 124 0.026% 97.800% ( 110, 170 ] 1957 0.416% 98.216% ( 170, 250 ] 3651 0.777% 98.993% ( 250, 380 ] 1297 0.276% 99.268% ( 380, 580 ] 1332 0.283% 99.552% ( 580, 870 ] 1114 0.237% 99.789% ( 870, 1300 ] 575 0.122% 99.911% ( 1300, 1900 ] 238 0.051% 99.962% ( 1900, 2900 ] 270 0.057% 100.019% ( 2900, 4400 ] 298 0.063% 100.083% ( 4400, 6600 ] 104 0.022% 100.105% ( 6600, 9900 ] 32 0.007% 100.111% ( 9900, 14000 ] 7 0.001% 100.113% ( 14000, 22000 ] 8 0.002% 100.115% ( 22000, 33000 ] 4 0.001% 100.116% ( 33000, 50000 ] 7 0.001% 100.117% ** Level 4 read latency histogram (micros): Count: 918781 Average: 33.5581 StdDev: 302.39 Min: 0 Median: 2.3997 Max: 51412 Percentiles: P50: 2.40 P75: 3.67 P99: 489.81 P99.9: 1196.21 P99.99: 1656.25 ------------------------------------------------------ [ 0, 1 ] 6694 0.729% 0.729% ( 1, 2 ] 344408 37.485% 38.214% ####### ( 2, 3 ] 270929 29.488% 67.702% ###### ( 3, 4 ] 100241 10.910% 78.612% ## ( 4, 6 ] 101459 11.043% 89.655% ## ( 6, 10 ] 23646 2.574% 92.228% # ( 10, 15 ] 4523 0.492% 92.721% ( 15, 22 ] 590 0.064% 92.785% ( 22, 34 ] 92 0.010% 92.795% ( 34, 51 ] 198 0.022% 92.816% ( 51, 76 ] 167 0.018% 92.835% ( 76, 110 ] 854 0.093% 92.928% ( 110, 170 ] 15760 1.715% 94.643% ( 170, 250 ] 28685 3.122% 97.765% # ( 250, 380 ] 7991 0.870% 98.635% ( 380, 580 ] 6113 0.665% 99.300% ( 580, 870 ] 4130 0.450% 99.750% ( 870, 1300 ] 1822 0.198% 99.948% ( 1300, 1900 ] 652 0.071% 100.019% ( 1900, 2900 ] 704 0.077% 100.095% ( 2900, 4400 ] 978 0.106% 100.202% ( 4400, 6600 ] 279 0.030% 100.232% ( 6600, 9900 ] 73 0.008% 100.240% ( 9900, 14000 ] 19 0.002% 100.242% ( 14000, 22000 ] 35 0.004% 100.246% ( 22000, 33000 ] 18 0.002% 100.248% ( 33000, 50000 ] 11 0.001% 100.249% ( 50000, 75000 ] 2 0.000% 100.249% ** Level 5 read latency histogram (micros): Count: 49113 Average: 359.6372 StdDev: 811.30 Min: 89 Median: 215.5495 Max: 47444 Percentiles: P50: 215.55 P75: 314.50 P99: 3467.09 P99.9: 7742.49 P99.99: 36084.65 ------------------------------------------------------ ( 76, 110 ] 598 1.218% 1.218% ( 110, 170 ] 11618 23.656% 24.873% ##### ( 170, 250 ] 21674 44.131% 69.004% ######### ( 250, 380 ] 5935 12.084% 81.089% ## ( 380, 580 ] 3975 8.094% 89.182% ## ( 580, 870 ] 2800 5.701% 94.883% # ( 870, 1300 ] 1104 2.248% 97.131% ( 1300, 1900 ] 351 0.715% 97.846% ( 1900, 2900 ] 382 0.778% 98.624% ( 2900, 4400 ] 489 0.996% 99.619% ( 4400, 6600 ] 123 0.250% 99.870% ( 6600, 9900 ] 43 0.088% 99.957% ( 9900, 14000 ] 1 0.002% 99.959% ( 14000, 22000 ] 7 0.014% 99.974% ( 22000, 33000 ] 7 0.014% 99.988% ( 33000, 50000 ] 6 0.012% 100.000% ** DB Stats ** Uptime(secs): 14.6 total, 4.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 201.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.117 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 244.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.312 H:M:S, 7.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/15-10:01:57 ... thread 0: (1000000,4000000) ops and (194487.1,203072.4) ops/second in (5.141729,19.697404) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.73 GB 12.6 3.4 0.0 3.4 7.1 3.7 0.0 1.9 108.1 227.4 32.01 24.64 71 0.451 3513K 17K 0.0 0.0 L1 9/9 715.31 MB 0.0 0.7 0.5 0.2 0.7 0.5 0.0 1.5 53.0 52.3 13.67 4.84 1 13.667 736K 9779 0.0 0.0 L3 18/0 980.31 MB 1.0 1.9 1.5 0.4 1.8 1.5 0.0 1.2 107.2 105.2 17.82 9.87 8 2.227 1596K 4970 0.0 0.0 L4 138/0 9.53 GB 1.0 5.3 2.0 3.3 4.8 1.5 0.2 2.4 139.1 125.6 39.09 24.58 21 1.861 1093K 0 0.0 0.0 L5 152/0 11.63 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/26 26.54 GB 0.0 11.3 3.9 7.3 14.4 7.1 2.5 3.9 112.4 144.1 102.59 63.94 101 1.016 6939K 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.3 3.9 7.3 14.4 7.1 2.5 3.9 112.4 144.1 102.59 63.94 101 1.016 6939K 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.3 3.9 7.3 10.7 3.4 0.0 0.0 132.6 125.8 86.99 53.02 43 2.023 6939K 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 246.0 15.60 10.92 58 0.269 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.8 total, 19.7 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.43 GB write, 747.71 MB/s write, 11.26 GB read, 583.38 MB/s read, 102.6 seconds Interval compaction: 14.43 GB write, 750.32 MB/s write, 11.26 GB read, 585.42 MB/s read, 102.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 16, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1128741 Average: 23.9198 StdDev: 190.33 Min: 0 Median: 1.6558 Max: 51425 Percentiles: P50: 1.66 P75: 2.46 P99: 353.94 P99.9: 1171.73 P99.99: 2792.55 ------------------------------------------------------ [ 0, 1 ] 169538 15.020% 15.020% ### ( 1, 2 ] 602044 53.338% 68.358% ########### ( 2, 3 ] 163891 14.520% 82.878% ### ( 3, 4 ] 53589 4.748% 87.625% # ( 4, 6 ] 43401 3.845% 91.470% # ( 6, 10 ] 11611 1.029% 92.499% ( 10, 15 ] 2290 0.203% 92.702% ( 15, 22 ] 354 0.031% 92.733% ( 22, 34 ] 102 0.009% 92.742% ( 34, 51 ] 34 0.003% 92.745% ( 51, 76 ] 23 0.002% 92.747% ( 76, 110 ] 1057 0.094% 92.841% ( 110, 170 ] 21965 1.946% 94.787% ( 170, 250 ] 40524 3.590% 98.377% # ( 250, 380 ] 8793 0.779% 99.156% ( 380, 580 ] 4921 0.436% 99.592% ( 580, 870 ] 2709 0.240% 99.832% ( 870, 1300 ] 1092 0.097% 99.929% ( 1300, 1900 ] 334 0.030% 99.958% ( 1900, 2900 ] 399 0.035% 99.994% ( 2900, 4400 ] 530 0.047% 100.041% ( 4400, 6600 ] 154 0.014% 100.054% ( 6600, 9900 ] 36 0.003% 100.058% ( 9900, 14000 ] 11 0.001% 100.059% ( 14000, 22000 ] 5 0.000% 100.059% ( 22000, 33000 ] 10 0.001% 100.060% ( 33000, 50000 ] 4 0.000% 100.060% ( 50000, 75000 ] 1 0.000% 100.060% ** Level 1 read latency histogram (micros): Count: 74461 Average: 31.0115 StdDev: 161.32 Min: 1 Median: 3.1402 Max: 26541 Percentiles: P50: 3.14 P75: 5.05 P99: 335.61 P99.9: 1263.70 P99.99: 5510.78 ------------------------------------------------------ [ 0, 1 ] 594 0.798% 0.798% ( 1, 2 ] 13986 18.783% 19.581% #### ( 2, 3 ] 20687 27.782% 47.363% ###### ( 3, 4 ] 14000 18.802% 66.165% #### ( 4, 6 ] 12541 16.842% 83.007% ### ( 6, 10 ] 2604 3.497% 86.504% # ( 10, 15 ] 891 1.197% 87.701% ( 15, 22 ] 324 0.435% 88.136% ( 22, 34 ] 85 0.114% 88.250% ( 34, 51 ] 18 0.024% 88.274% ( 51, 76 ] 2 0.003% 88.277% ( 76, 110 ] 128 0.172% 88.449% ( 110, 170 ] 2636 3.540% 91.989% # ( 170, 250 ] 4737 6.362% 98.351% # ( 250, 380 ] 734 0.986% 99.337% ( 380, 580 ] 281 0.377% 99.714% ( 580, 870 ] 101 0.136% 99.850% ( 870, 1300 ] 41 0.055% 99.905% ( 1300, 1900 ] 18 0.024% 99.929% ( 1900, 2900 ] 17 0.023% 99.952% ( 2900, 4400 ] 23 0.031% 99.983% ( 4400, 6600 ] 11 0.015% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ( 22000, 33000 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 289280 Average: 14.5423 StdDev: 274.16 Min: 1 Median: 2.2697 Max: 36088 Percentiles: P50: 2.27 P75: 3.23 P99: 12.42 P99.9: 1195.92 P99.99: 2474.52 ------------------------------------------------------ [ 0, 1 ] 2588 0.895% 0.895% ( 1, 2 ] 118134 40.837% 41.732% ######## ( 2, 3 ] 88674 30.653% 72.385% ###### ( 3, 4 ] 32929 11.383% 83.768% ## ( 4, 6 ] 34494 11.924% 95.692% ## ( 6, 10 ] 8607 2.975% 98.668% # ( 10, 15 ] 1987 0.687% 99.355% ( 15, 22 ] 368 0.127% 99.482% ( 22, 34 ] 48 0.017% 99.498% ( 34, 51 ] 56 0.019% 99.518% ( 51, 76 ] 38 0.013% 99.531% ( 76, 110 ] 21 0.007% 99.538% ( 110, 170 ] 30 0.010% 99.549% ( 170, 250 ] 38 0.013% 99.562% ( 250, 380 ] 166 0.057% 99.619% ( 380, 580 ] 334 0.115% 99.735% ( 580, 870 ] 315 0.109% 99.843% ( 870, 1300 ] 216 0.075% 99.918% ( 1300, 1900 ] 115 0.040% 99.958% ( 1900, 2900 ] 162 0.056% 100.014% ( 2900, 4400 ] 224 0.077% 100.091% ( 4400, 6600 ] 84 0.029% 100.120% ( 6600, 9900 ] 31 0.011% 100.131% ( 9900, 14000 ] 7 0.002% 100.133% ( 14000, 22000 ] 11 0.004% 100.137% ( 22000, 33000 ] 6 0.002% 100.139% ( 33000, 50000 ] 4 0.001% 100.141% ** Level 3 read latency histogram (micros): Count: 474633 Average: 19.5344 StdDev: 251.85 Min: 1 Median: 2.3581 Max: 47396 Percentiles: P50: 2.36 P75: 3.42 P99: 284.37 P99.9: 1257.72 P99.99: 2390.88 ------------------------------------------------------ [ 0, 1 ] 3498 0.737% 0.737% ( 1, 2 ] 180191 37.964% 38.701% ######## ( 2, 3 ] 149762 31.553% 70.254% ###### ( 3, 4 ] 53439 11.259% 81.514% ## ( 4, 6 ] 56492 11.902% 93.416% ## ( 6, 10 ] 13271 2.796% 96.212% # ( 10, 15 ] 2412 0.508% 96.720% ( 15, 22 ] 304 0.064% 96.784% ( 22, 34 ] 51 0.011% 96.795% ( 34, 51 ] 95 0.020% 96.815% ( 51, 76 ] 105 0.022% 96.837% ( 76, 110 ] 198 0.042% 96.879% ( 110, 170 ] 3496 0.737% 97.615% ( 170, 250 ] 6146 1.295% 98.910% ( 250, 380 ] 1614 0.340% 99.250% ( 380, 580 ] 1436 0.303% 99.553% ( 580, 870 ] 1129 0.238% 99.791% ( 870, 1300 ] 576 0.121% 99.912% ( 1300, 1900 ] 238 0.050% 99.962% ( 1900, 2900 ] 270 0.057% 100.019% ( 2900, 4400 ] 298 0.063% 100.082% ( 4400, 6600 ] 104 0.022% 100.104% ( 6600, 9900 ] 32 0.007% 100.110% ( 9900, 14000 ] 7 0.001% 100.112% ( 14000, 22000 ] 8 0.002% 100.114% ( 22000, 33000 ] 4 0.001% 100.114% ( 33000, 50000 ] 7 0.001% 100.116% ** Level 4 read latency histogram (micros): Count: 956373 Average: 39.8193 StdDev: 298.24 Min: 0 Median: 2.4691 Max: 51412 Percentiles: P50: 2.47 P75: 3.95 P99: 491.16 P99.9: 1187.46 P99.99: 1652.79 ------------------------------------------------------ [ 0, 1 ] 6694 0.700% 0.700% ( 1, 2 ] 344408 36.012% 36.712% ####### ( 2, 3 ] 270929 28.329% 65.041% ###### ( 3, 4 ] 100241 10.481% 75.522% ## ( 4, 6 ] 101459 10.609% 86.131% ## ( 6, 10 ] 23646 2.472% 88.603% ( 10, 15 ] 4523 0.473% 89.076% ( 15, 22 ] 590 0.062% 89.138% ( 22, 34 ] 92 0.010% 89.147% ( 34, 51 ] 198 0.021% 89.168% ( 51, 76 ] 167 0.017% 89.186% ( 76, 110 ] 1533 0.160% 89.346% ( 110, 170 ] 28499 2.980% 92.326% # ( 170, 250 ] 49394 5.165% 97.491% # ( 250, 380 ] 10645 1.113% 98.604% ( 380, 580 ] 6821 0.713% 99.317% ( 580, 870 ] 4231 0.442% 99.759% ( 870, 1300 ] 1824 0.191% 99.950% ( 1300, 1900 ] 652 0.068% 100.018% ( 1900, 2900 ] 704 0.074% 100.092% ( 2900, 4400 ] 978 0.102% 100.194% ( 4400, 6600 ] 279 0.029% 100.223% ( 6600, 9900 ] 73 0.008% 100.231% ( 9900, 14000 ] 19 0.002% 100.233% ( 14000, 22000 ] 35 0.004% 100.236% ( 22000, 33000 ] 18 0.002% 100.238% ( 33000, 50000 ] 11 0.001% 100.239% ( 50000, 75000 ] 2 0.000% 100.240% ** Level 5 read latency histogram (micros): Count: 76742 Average: 300.0095 StdDev: 655.03 Min: 89 Median: 205.4957 Max: 47444 Percentiles: P50: 205.50 P75: 247.00 P99: 2658.69 P99.9: 6354.21 P99.99: 28797.69 ------------------------------------------------------ ( 76, 110 ] 1034 1.347% 1.347% ( 110, 170 ] 20930 27.273% 28.621% ##### ( 170, 250 ] 36978 48.185% 76.805% ########## ( 250, 380 ] 7838 10.213% 87.019% ## ( 380, 580 ] 4585 5.975% 92.993% # ( 580, 870 ] 2860 3.727% 96.720% # ( 870, 1300 ] 1106 1.441% 98.161% ( 1300, 1900 ] 353 0.460% 98.621% ( 1900, 2900 ] 383 0.499% 99.120% ( 2900, 4400 ] 489 0.637% 99.758% ( 4400, 6600 ] 123 0.160% 99.918% ( 6600, 9900 ] 43 0.056% 99.974% ( 9900, 14000 ] 1 0.001% 99.975% ( 14000, 22000 ] 7 0.009% 99.984% ( 22000, 33000 ] 7 0.009% 99.993% ( 33000, 50000 ] 6 0.008% 100.001% ** DB Stats ** Uptime(secs): 19.8 total, 5.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 199.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.447 H:M:S, 17.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 191.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.330 H:M:S, 25.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 347.560 micros/op 11454 ops/sec 20.166 seconds 230996 operations; 11.1 MB/s (57999 of 57999 found) Microseconds per read: Count: 230996 Average: 347.5737 StdDev: 962.75 Min: 2 Median: 230.8711 Max: 125155 Percentiles: P50: 230.87 P75: 338.15 P99: 2577.80 P99.9: 13111.04 P99.99: 36786.67 ------------------------------------------------------ ( 1, 2 ] 9 0.004% 0.004% ( 2, 3 ] 85 0.037% 0.041% ( 3, 4 ] 102 0.044% 0.085% ( 4, 6 ] 238 0.103% 0.188% ( 6, 10 ] 379 0.164% 0.352% ( 10, 15 ] 1729 0.748% 1.100% ( 15, 22 ] 3645 1.578% 2.678% ( 22, 34 ] 4695 2.033% 4.711% ( 34, 51 ] 2583 1.118% 5.829% ( 51, 76 ] 442 0.191% 6.020% ( 76, 110 ] 169 0.073% 6.094% ( 110, 170 ] 19472 8.430% 14.523% ## ( 170, 250 ] 107703 46.625% 61.149% ######### ( 250, 380 ] 47187 20.428% 81.576% #### ( 380, 580 ] 24074 10.422% 91.998% ## ( 580, 870 ] 10366 4.488% 96.486% # ( 870, 1300 ] 3991 1.728% 98.213% ( 1300, 1900 ] 1226 0.531% 98.744% ( 1900, 2900 ] 872 0.377% 99.122% ( 2900, 4400 ] 1149 0.497% 99.619% ( 4400, 6600 ] 381 0.165% 99.784% ( 6600, 9900 ] 203 0.088% 99.872% ( 9900, 14000 ] 83 0.036% 99.908% ( 14000, 22000 ] 113 0.049% 99.957% ( 22000, 33000 ] 72 0.031% 99.988% ( 33000, 50000 ] 22 0.010% 99.997% ( 50000, 75000 ] 4 0.002% 99.999% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3761185 rocksdb.bloom.filter.full.positive COUNT : 266501 rocksdb.bloom.filter.full.true.positive COUNT : 229911 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 1085 rocksdb.memtable.miss COUNT : 229911 rocksdb.l0.hit COUNT : 28717 rocksdb.l1.hit COUNT : 4691 rocksdb.l2andup.hit COUNT : 196503 rocksdb.compaction.key.drop.new COUNT : 613050 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4021625 rocksdb.number.keys.read COUNT : 230996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4150317000 rocksdb.bytes.read COUNT : 230996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 491 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3799708 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 12541060679 rocksdb.compact.write.bytes COUNT : 11904376302 rocksdb.flush.write.bytes COUNT : 4089377105 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 22 rocksdb.number.superversion_acquires COUNT : 708 rocksdb.number.superversion_releases COUNT : 676 rocksdb.number.superversion_cleanups COUNT : 173 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 139 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4062548992 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7216128 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 12755497151 rocksdb.non.last.level.read.count COUNT : 3051728 rocksdb.block.checksum.compute.count COUNT : 3307268 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 230.187023 P95 : 773.104891 P99 : 2575.504587 P100 : 125153.000000 COUNT : 230996 SUM : 80077990 rocksdb.db.write.micros P50 : 1.588246 P95 : 5.112284 P99 : 7.822258 P100 : 558686.000000 COUNT : 4021625 SUM : 14994353 rocksdb.compaction.times.micros P50 : 1643333.333333 P95 : 2889285.714286 P99 : 12194000.000000 P100 : 13667375.000000 COUNT : 43 SUM : 86991130 rocksdb.compaction.times.cpu_micros P50 : 1119473.684211 P95 : 1893000.000000 P99 : 4838913.000000 P100 : 4838913.000000 COUNT : 43 SUM : 53015700 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 913.000000 P95 : 3425.000000 P99 : 7801.000000 P100 : 7801.000000 COUNT : 59 SUM : 72948 rocksdb.compaction.outfile.sync.micros P50 : 2000.000000 P95 : 8100.000000 P99 : 9780.000000 P100 : 9908.000000 COUNT : 140 SUM : 378110 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 186.000000 P95 : 2250.000000 P99 : 6336.000000 P100 : 8316.000000 COUNT : 112 SUM : 54734 rocksdb.table.open.io.micros P50 : 5854.022989 P95 : 20041.025641 P99 : 29927.857143 P100 : 36020.000000 COUNT : 491 SUM : 3349739 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.277675 P95 : 9.781452 P99 : 226.010446 P100 : 51430.000000 COUNT : 3037409 SUM : 47876689 rocksdb.read.block.get.micros P50 : 198.916720 P95 : 638.007263 P99 : 2124.517454 P100 : 51035.000000 COUNT : 269632 SUM : 70819674 rocksdb.write.raw.block.micros P50 : 0.539272 P95 : 1.465142 P99 : 4.260516 P100 : 65103.000000 COUNT : 3875052 SUM : 13605801 rocksdb.numfiles.in.singlecompaction P50 : 3.250000 P95 : 5.800000 P99 : 18.220000 P100 : 21.000000 COUNT : 54 SUM : 216 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558414 P95 : 1096.493414 P99 : 1265.340395 P100 : 558494.000000 COUNT : 17886 SUM : 3801570 rocksdb.sst.read.micros P50 : 2.075962 P95 : 204.819269 P99 : 504.973481 P100 : 51425.000000 COUNT : 3052158 SUM : 105929270 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 230996 SUM : 230996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4021625 SUM : 4150317000 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221304.347826 P95 : 577250.000000 P99 : 874952.000000 P100 : 874952.000000 COUNT : 59 SUM : 15779885 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 154 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0