[2024-07-14 03:01:50.688817] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 22.11.4 initialization... [2024-07-14 03:01:50.689025] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2489880 ] Set seed to 1720918910683792 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-14 03:01:50.781750] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-14 03:01:50.821238] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-14 03:01:50.821287] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2489880' to capture a snapshot of events at runtime. [2024-07-14 03:01:50.821299] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2489880 for offline analysis/debug. [2024-07-14 03:01:50.821328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 14 03:01:55 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/14-03:02:03 ... thread 0: (1000000,1000000) ops and (127024.0,127024.0) ops/second in (7.872530,7.872530) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.70 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 37.5 118.7 10.08 4.20 10 1.008 383K 545 0.0 0.0 L1 8/8 874.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 128.78 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 39/8 2.26 GB 1.7 3.6 2.4 1.2 3.5 2.4 0.1 1.5 101.7 101.0 35.89 17.05 14 2.563 1492K 3946 0.0 0.0 L4 198/15 11.53 GB 1.1 3.0 1.8 1.2 3.0 1.8 0.0 1.6 107.2 105.8 28.61 14.99 24 1.192 1960K 4130 0.0 0.0 L5 1092/0 89.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1348/39 106.41 GB 0.0 6.9 4.2 2.7 7.7 5.0 0.1 9.6 95.1 105.2 74.58 36.23 48 1.554 3836K 8621 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 4.2 2.7 7.7 5.0 0.1 9.6 95.1 105.2 74.58 36.23 48 1.554 3836K 8621 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 4.2 2.7 6.9 4.2 0.0 0.0 105.5 104.5 67.29 33.75 39 1.725 3836K 8621 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 112.3 7.29 2.48 9 0.810 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.1 total, 7.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.66 GB write, 972.49 MB/s write, 6.93 GB read, 879.15 MB/s read, 74.6 seconds Interval compaction: 7.66 GB write, 996.76 MB/s write, 6.93 GB read, 901.09 MB/s read, 74.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 33, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 274763 Average: 12.5338 StdDev: 239.40 Min: 1 Median: 1.8412 Max: 43840 Percentiles: P50: 1.84 P75: 2.93 P99: 11.46 P99.9: 2262.04 P99.99: 5328.47 ------------------------------------------------------ [ 0, 1 ] 17416 6.339% 6.339% # ( 1, 2 ] 142614 51.904% 58.243% ########## ( 2, 3 ] 49567 18.040% 76.283% #### ( 3, 4 ] 26167 9.523% 85.806% ## ( 4, 6 ] 28966 10.542% 96.348% ## ( 6, 10 ] 6855 2.495% 98.843% ( 10, 15 ] 1479 0.538% 99.382% ( 15, 22 ] 179 0.065% 99.447% ( 22, 34 ] 20 0.007% 99.454% ( 34, 51 ] 3 0.001% 99.455% ( 51, 76 ] 10 0.004% 99.459% ( 76, 110 ] 7 0.003% 99.461% ( 110, 170 ] 19 0.007% 99.468% ( 170, 250 ] 44 0.016% 99.484% ( 250, 380 ] 87 0.032% 99.516% ( 380, 580 ] 185 0.067% 99.583% ( 580, 870 ] 304 0.111% 99.694% ( 870, 1300 ] 300 0.109% 99.803% ( 1300, 1900 ] 218 0.079% 99.882% ( 1900, 2900 ] 136 0.049% 99.932% ( 2900, 4400 ] 139 0.051% 99.983% ( 4400, 6600 ] 51 0.019% 100.001% ( 6600, 9900 ] 18 0.007% 100.008% ( 9900, 14000 ] 6 0.002% 100.010% ( 14000, 22000 ] 9 0.003% 100.013% ( 22000, 33000 ] 6 0.002% 100.015% ( 33000, 50000 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 48099 Average: 20.7733 StdDev: 243.84 Min: 1 Median: 1.9880 Max: 12927 Percentiles: P50: 1.99 P75: 3.31 P99: 15.65 P99.9: 4222.53 P99.99: 8103.90 ------------------------------------------------------ [ 0, 1 ] 1340 2.786% 2.786% # ( 1, 2 ] 22986 47.789% 50.575% ########## ( 2, 3 ] 10138 21.077% 71.652% #### ( 3, 4 ] 5166 10.740% 82.393% ## ( 4, 6 ] 6210 12.911% 95.303% ### ( 6, 10 ] 1381 2.871% 98.175% # ( 10, 15 ] 392 0.815% 98.990% ( 15, 22 ] 54 0.112% 99.102% ( 22, 34 ] 8 0.017% 99.118% ( 34, 51 ] 2 0.004% 99.123% ( 51, 76 ] 3 0.006% 99.129% ( 110, 170 ] 4 0.008% 99.137% ( 170, 250 ] 5 0.010% 99.148% ( 250, 380 ] 11 0.023% 99.170% ( 380, 580 ] 36 0.075% 99.245% ( 580, 870 ] 53 0.110% 99.355% ( 870, 1300 ] 78 0.162% 99.518% ( 1300, 1900 ] 64 0.133% 99.651% ( 1900, 2900 ] 67 0.139% 99.790% ( 2900, 4400 ] 60 0.125% 99.915% ( 4400, 6600 ] 33 0.069% 99.983% ( 6600, 9900 ] 7 0.015% 99.998% ( 9900, 14000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 424541 Average: 15.9567 StdDev: 240.70 Min: 1 Median: 1.9188 Max: 35572 Percentiles: P50: 1.92 P75: 3.08 P99: 13.42 P99.9: 2330.56 P99.99: 3583.29 ------------------------------------------------------ [ 0, 1 ] 18314 4.314% 4.314% # ( 1, 2 ] 211097 49.724% 54.037% ########## ( 2, 3 ] 85494 20.138% 74.175% #### ( 3, 4 ] 43060 10.143% 84.318% ## ( 4, 6 ] 47959 11.297% 95.615% ## ( 6, 10 ] 12079 2.845% 98.460% # ( 10, 15 ] 3354 0.790% 99.250% ( 15, 22 ] 423 0.100% 99.350% ( 22, 34 ] 48 0.011% 99.361% ( 34, 51 ] 37 0.009% 99.370% ( 51, 76 ] 28 0.007% 99.376% ( 76, 110 ] 15 0.004% 99.380% ( 110, 170 ] 34 0.008% 99.388% ( 170, 250 ] 62 0.015% 99.402% ( 250, 380 ] 142 0.033% 99.436% ( 380, 580 ] 290 0.068% 99.504% ( 580, 870 ] 490 0.115% 99.620% ( 870, 1300 ] 569 0.134% 99.754% ( 1300, 1900 ] 460 0.108% 99.862% ( 1900, 2900 ] 375 0.088% 99.950% ( 2900, 4400 ] 370 0.087% 100.037% ( 4400, 6600 ] 118 0.028% 100.065% ( 6600, 9900 ] 42 0.010% 100.075% ( 9900, 14000 ] 5 0.001% 100.076% ( 14000, 22000 ] 13 0.003% 100.079% ( 22000, 33000 ] 7 0.002% 100.081% ( 33000, 50000 ] 1 0.000% 100.081% ** Level 3 read latency histogram (micros): Count: 612843 Average: 10.5589 StdDev: 161.36 Min: 1 Median: 1.9261 Max: 23016 Percentiles: P50: 1.93 P75: 3.06 P99: 9.91 P99.9: 1053.00 P99.99: 1637.07 ------------------------------------------------------ [ 0, 1 ] 20364 3.323% 3.323% # ( 1, 2 ] 308886 50.402% 53.725% ########## ( 2, 3 ] 126533 20.647% 74.372% #### ( 3, 4 ] 64228 10.480% 84.852% ## ( 4, 6 ] 72619 11.850% 96.702% ## ( 6, 10 ] 14408 2.351% 99.053% ( 10, 15 ] 3429 0.560% 99.612% ( 15, 22 ] 397 0.065% 99.677% ( 22, 34 ] 39 0.006% 99.683% ( 34, 51 ] 19 0.003% 99.687% ( 51, 76 ] 44 0.007% 99.694% ( 76, 110 ] 13 0.002% 99.696% ( 110, 170 ] 28 0.005% 99.700% ( 170, 250 ] 85 0.014% 99.714% ( 250, 380 ] 143 0.023% 99.738% ( 380, 580 ] 269 0.044% 99.782% ( 580, 870 ] 485 0.079% 99.861% ( 870, 1300 ] 569 0.093% 99.953% ( 1300, 1900 ] 400 0.065% 100.019% ( 1900, 2900 ] 303 0.049% 100.068% ( 2900, 4400 ] 344 0.056% 100.124% ( 4400, 6600 ] 108 0.018% 100.142% ( 6600, 9900 ] 24 0.004% 100.146% ( 9900, 14000 ] 4 0.001% 100.147% ( 14000, 22000 ] 5 0.001% 100.147% ( 22000, 33000 ] 3 0.000% 100.148% ** Level 4 read latency histogram (micros): Count: 335643 Average: 30.2308 StdDev: 390.38 Min: 1 Median: 1.9129 Max: 45983 Percentiles: P50: 1.91 P75: 3.09 P99: 688.37 P99.9: 3458.62 P99.99: 4300.84 ------------------------------------------------------ [ 0, 1 ] 12972 3.865% 3.865% # ( 1, 2 ] 169624 50.537% 54.402% ########## ( 2, 3 ] 65869 19.625% 74.027% #### ( 3, 4 ] 35027 10.436% 84.462% ## ( 4, 6 ] 36978 11.017% 95.479% ## ( 6, 10 ] 8196 2.442% 97.921% ( 10, 15 ] 2074 0.618% 98.539% ( 15, 22 ] 188 0.056% 98.595% ( 22, 34 ] 21 0.006% 98.601% ( 34, 51 ] 17 0.005% 98.607% ( 51, 76 ] 28 0.008% 98.615% ( 76, 110 ] 24 0.007% 98.622% ( 110, 170 ] 37 0.011% 98.633% ( 170, 250 ] 129 0.038% 98.672% ( 250, 380 ] 241 0.072% 98.743% ( 380, 580 ] 529 0.158% 98.901% ( 580, 870 ] 890 0.265% 99.166% ( 870, 1300 ] 1005 0.299% 99.466% ( 1300, 1900 ] 713 0.212% 99.678% ( 1900, 2900 ] 545 0.162% 99.840% ( 2900, 4400 ] 538 0.160% 100.001% ( 4400, 6600 ] 205 0.061% 100.062% ( 6600, 9900 ] 68 0.020% 100.082% ( 9900, 14000 ] 11 0.003% 100.085% ( 14000, 22000 ] 29 0.009% 100.094% ( 22000, 33000 ] 12 0.004% 100.097% ( 33000, 50000 ] 7 0.002% 100.100% ** Level 5 read latency histogram (micros): Count: 11884 Average: 1890.5032 StdDev: 2242.48 Min: 83 Median: 1218.0126 Max: 46005 Percentiles: P50: 1218.01 P75: 2587.37 P99: 8421.96 P99.9: 33164.33 P99.99: 46005.00 ------------------------------------------------------ ( 76, 110 ] 7 0.059% 0.059% ( 110, 170 ] 68 0.572% 0.631% ( 170, 250 ] 168 1.414% 2.045% ( 250, 380 ] 545 4.586% 6.631% # ( 380, 580 ] 1299 10.931% 17.561% ## ( 580, 870 ] 2051 17.258% 34.820% ### ( 870, 1300 ] 2229 18.756% 53.576% #### ( 1300, 1900 ] 1583 13.320% 66.897% ### ( 1900, 2900 ] 1401 11.789% 78.686% ## ( 2900, 4400 ] 1594 13.413% 92.099% ### ( 4400, 6600 ] 739 6.218% 98.317% # ( 6600, 9900 ] 147 1.237% 99.554% ( 9900, 14000 ] 12 0.101% 99.655% ( 14000, 22000 ] 12 0.101% 99.756% ( 22000, 33000 ] 17 0.143% 99.899% ( 33000, 50000 ] 12 0.101% 100.000% ** DB Stats ** Uptime(secs): 8.1 total, 7.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 121.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.686 H:M:S, 45.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 124.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.686 H:M:S, 46.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/14-03:02:08 ... thread 0: (1000000,2000000) ops and (189535.4,152107.6) ops/second in (5.276060,13.148590) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.74 GB 163.6 1.3 0.0 1.3 3.1 1.8 0.0 1.7 65.1 157.9 20.33 10.90 28 0.726 1343K 1682 0.0 0.0 L1 8/8 874.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 983.82 MB 1.0 3.6 2.4 1.2 3.5 2.4 0.3 1.5 101.7 101.0 35.89 17.05 14 2.563 1492K 3946 0.0 0.0 L4 172/0 9.64 GB 1.0 6.0 3.3 2.8 5.9 3.2 0.0 1.8 112.1 110.4 55.04 29.16 46 1.196 3705K 5574 0.0 0.0 L5 1132/0 93.20 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1344/16 107.40 GB 0.0 10.9 5.6 5.2 12.6 7.4 3.5 6.8 100.2 116.1 111.25 57.12 88 1.264 6541K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.9 5.6 5.2 12.6 7.4 3.5 6.8 100.2 116.1 111.25 57.12 88 1.264 6541K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.9 5.6 5.2 10.8 5.5 0.0 0.0 112.9 111.7 98.69 51.65 64 1.542 6541K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 150.4 12.57 5.47 24 0.524 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.3 total, 13.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.61 GB write, 967.41 MB/s write, 10.88 GB read, 834.89 MB/s read, 111.3 seconds Interval compaction: 12.61 GB write, 981.87 MB/s write, 10.88 GB read, 847.37 MB/s read, 111.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 55, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 607718 Average: 12.5920 StdDev: 191.15 Min: 1 Median: 1.7550 Max: 43840 Percentiles: P50: 1.75 P75: 2.73 P99: 160.47 P99.9: 1804.83 P99.99: 4171.43 ------------------------------------------------------ [ 0, 1 ] 58044 9.551% 9.551% ## ( 1, 2 ] 325586 53.575% 63.126% ########### ( 2, 3 ] 98608 16.226% 79.352% ### ( 3, 4 ] 48852 8.039% 87.391% ## ( 4, 6 ] 52564 8.649% 96.040% ## ( 6, 10 ] 11982 1.972% 98.012% ( 10, 15 ] 2670 0.439% 98.451% ( 15, 22 ] 325 0.053% 98.505% ( 22, 34 ] 23 0.004% 98.509% ( 34, 51 ] 9 0.001% 98.510% ( 51, 76 ] 27 0.004% 98.514% ( 76, 110 ] 636 0.105% 98.619% ( 110, 170 ] 2752 0.453% 99.072% ( 170, 250 ] 1537 0.253% 99.325% ( 250, 380 ] 786 0.129% 99.454% ( 380, 580 ] 955 0.157% 99.611% ( 580, 870 ] 776 0.128% 99.739% ( 870, 1300 ] 635 0.104% 99.844% ( 1300, 1900 ] 408 0.067% 99.911% ( 1900, 2900 ] 261 0.043% 99.954% ( 2900, 4400 ] 261 0.043% 99.997% ( 4400, 6600 ] 94 0.015% 100.012% ( 6600, 9900 ] 23 0.004% 100.016% ( 9900, 14000 ] 7 0.001% 100.017% ( 14000, 22000 ] 13 0.002% 100.019% ( 22000, 33000 ] 6 0.001% 100.020% ( 33000, 50000 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 134973 Average: 13.8661 StdDev: 177.01 Min: 1 Median: 2.2065 Max: 12927 Percentiles: P50: 2.21 P75: 3.51 P99: 18.21 P99.9: 3079.79 P99.99: 6521.57 ------------------------------------------------------ [ 0, 1 ] 2889 2.140% 2.140% ( 1, 2 ] 58011 42.980% 45.120% ######### ( 2, 3 ] 31895 23.631% 68.751% ##### ( 3, 4 ] 16570 12.277% 81.027% ## ( 4, 6 ] 18195 13.480% 94.508% ### ( 6, 10 ] 4695 3.478% 97.986% # ( 10, 15 ] 1218 0.902% 98.889% ( 15, 22 ] 328 0.243% 99.132% ( 22, 34 ] 36 0.027% 99.158% ( 34, 51 ] 4 0.003% 99.161% ( 51, 76 ] 11 0.008% 99.169% ( 76, 110 ] 32 0.024% 99.193% ( 110, 170 ] 191 0.142% 99.335% ( 170, 250 ] 90 0.067% 99.401% ( 250, 380 ] 64 0.047% 99.449% ( 380, 580 ] 102 0.076% 99.524% ( 580, 870 ] 144 0.107% 99.631% ( 870, 1300 ] 138 0.102% 99.733% ( 1300, 1900 ] 91 0.067% 99.801% ( 1900, 2900 ] 123 0.091% 99.892% ( 2900, 4400 ] 92 0.068% 99.960% ( 4400, 6600 ] 42 0.031% 99.991% ( 6600, 9900 ] 11 0.008% 99.999% ( 9900, 14000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 457256 Average: 15.7669 StdDev: 236.75 Min: 1 Median: 1.9255 Max: 35572 Percentiles: P50: 1.93 P75: 3.08 P99: 13.38 P99.9: 2400.62 P99.99: 3689.71 ------------------------------------------------------ [ 0, 1 ] 18863 4.125% 4.125% # ( 1, 2 ] 226662 49.570% 53.695% ########## ( 2, 3 ] 93470 20.442% 74.137% #### ( 3, 4 ] 46493 10.168% 84.305% ## ( 4, 6 ] 51712 11.309% 95.614% ## ( 6, 10 ] 13051 2.854% 98.468% # ( 10, 15 ] 3601 0.788% 99.256% ( 15, 22 ] 467 0.102% 99.358% ( 22, 34 ] 51 0.011% 99.369% ( 34, 51 ] 37 0.008% 99.377% ( 51, 76 ] 29 0.006% 99.383% ( 76, 110 ] 15 0.003% 99.387% ( 110, 170 ] 36 0.008% 99.394% ( 170, 250 ] 63 0.014% 99.408% ( 250, 380 ] 149 0.033% 99.441% ( 380, 580 ] 306 0.067% 99.508% ( 580, 870 ] 518 0.113% 99.621% ( 870, 1300 ] 600 0.131% 99.752% ( 1300, 1900 ] 478 0.105% 99.857% ( 1900, 2900 ] 395 0.086% 99.943% ( 2900, 4400 ] 407 0.089% 100.032% ( 4400, 6600 ] 129 0.028% 100.060% ( 6600, 9900 ] 43 0.009% 100.070% ( 9900, 14000 ] 5 0.001% 100.071% ( 14000, 22000 ] 13 0.003% 100.074% ( 22000, 33000 ] 7 0.002% 100.075% ( 33000, 50000 ] 1 0.000% 100.075% ** Level 3 read latency histogram (micros): Count: 921877 Average: 10.1861 StdDev: 152.19 Min: 1 Median: 1.9246 Max: 24967 Percentiles: P50: 1.92 P75: 3.07 P99: 10.26 P99.9: 1048.67 P99.99: 1609.68 ------------------------------------------------------ [ 0, 1 ] 30040 3.259% 3.259% # ( 1, 2 ] 466031 50.552% 53.811% ########## ( 2, 3 ] 189039 20.506% 74.317% #### ( 3, 4 ] 95105 10.316% 84.633% ## ( 4, 6 ] 109031 11.827% 96.460% ## ( 6, 10 ] 23136 2.510% 98.970% # ( 10, 15 ] 5336 0.579% 99.549% ( 15, 22 ] 622 0.067% 99.616% ( 22, 34 ] 61 0.007% 99.623% ( 34, 51 ] 45 0.005% 99.628% ( 51, 76 ] 90 0.010% 99.638% ( 76, 110 ] 69 0.007% 99.645% ( 110, 170 ] 208 0.023% 99.668% ( 170, 250 ] 214 0.023% 99.691% ( 250, 380 ] 270 0.029% 99.720% ( 380, 580 ] 482 0.052% 99.772% ( 580, 870 ] 798 0.087% 99.859% ( 870, 1300 ] 910 0.099% 99.958% ( 1300, 1900 ] 577 0.063% 100.020% ( 1900, 2900 ] 432 0.047% 100.067% ( 2900, 4400 ] 449 0.049% 100.116% ( 4400, 6600 ] 142 0.015% 100.131% ( 6600, 9900 ] 27 0.003% 100.134% ( 9900, 14000 ] 4 0.000% 100.135% ( 14000, 22000 ] 8 0.001% 100.135% ( 22000, 33000 ] 4 0.000% 100.136% ** Level 4 read latency histogram (micros): Count: 725717 Average: 23.9697 StdDev: 303.54 Min: 0 Median: 1.9134 Max: 45983 Percentiles: P50: 1.91 P75: 3.09 P99: 390.43 P99.9: 2601.76 P99.99: 3514.10 ------------------------------------------------------ [ 0, 1 ] 26613 3.667% 3.667% # ( 1, 2 ] 368111 50.724% 54.391% ########## ( 2, 3 ] 142977 19.701% 74.092% #### ( 3, 4 ] 74226 10.228% 84.320% ## ( 4, 6 ] 79039 10.891% 95.211% ## ( 6, 10 ] 18594 2.562% 97.774% # ( 10, 15 ] 4583 0.632% 98.405% ( 15, 22 ] 448 0.062% 98.467% ( 22, 34 ] 43 0.006% 98.473% ( 34, 51 ] 45 0.006% 98.479% ( 51, 76 ] 78 0.011% 98.490% ( 76, 110 ] 436 0.060% 98.550% ( 110, 170 ] 1480 0.204% 98.754% ( 170, 250 ] 926 0.128% 98.881% ( 250, 380 ] 793 0.109% 98.991% ( 380, 580 ] 1301 0.179% 99.170% ( 580, 870 ] 1759 0.242% 99.412% ( 870, 1300 ] 1763 0.243% 99.655% ( 1300, 1900 ] 1144 0.158% 99.813% ( 1900, 2900 ] 901 0.124% 99.937% ( 2900, 4400 ] 939 0.129% 100.066% ( 4400, 6600 ] 313 0.043% 100.110% ( 6600, 9900 ] 87 0.012% 100.122% ( 9900, 14000 ] 11 0.002% 100.123% ( 14000, 22000 ] 38 0.005% 100.128% ( 22000, 33000 ] 12 0.002% 100.130% ( 33000, 50000 ] 7 0.001% 100.131% ** Level 5 read latency histogram (micros): Count: 43300 Average: 865.2289 StdDev: 1480.33 Min: 74 Median: 341.5617 Max: 46005 Percentiles: P50: 341.56 P75: 993.95 P99: 6079.26 P99.9: 12328.46 P99.99: 35365.83 ------------------------------------------------------ ( 51, 76 ] 2 0.005% 0.005% ( 76, 110 ] 2863 6.612% 6.617% # ( 110, 170 ] 11085 25.600% 32.217% ##### ( 170, 250 ] 5418 12.513% 44.730% ### ( 250, 380 ] 3240 7.483% 52.212% # ( 380, 580 ] 4209 9.721% 61.933% ## ( 580, 870 ] 4473 10.330% 72.263% ## ( 870, 1300 ] 4111 9.494% 81.758% ## ( 1300, 1900 ] 2559 5.910% 87.667% # ( 1900, 2900 ] 2022 4.670% 92.337% # ( 2900, 4400 ] 2182 5.039% 97.376% # ( 4400, 6600 ] 921 2.127% 99.503% ( 6600, 9900 ] 164 0.379% 99.882% ( 9900, 14000 ] 13 0.030% 99.912% ( 14000, 22000 ] 15 0.035% 99.947% ( 22000, 33000 ] 17 0.039% 99.986% ( 33000, 50000 ] 12 0.028% 100.014% ** DB Stats ** Uptime(secs): 13.3 total, 5.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 147.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.261 H:M:S, 39.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 186.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.575 H:M:S, 29.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-03:02:11 ... thread 0: (1000000,3000000) ops and (279941.9,179417.7) ops/second in (3.572170,16.720760) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.67 GB 258.0 2.3 0.0 2.3 5.0 2.8 0.0 1.8 85.5 189.3 27.28 17.37 47 0.580 2366K 2671 0.0 0.0 L1 8/8 874.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 983.82 MB 1.0 3.6 2.4 1.2 3.5 2.4 0.3 1.5 101.7 101.0 35.89 17.05 14 2.563 1492K 3946 0.0 0.0 L4 172/0 9.64 GB 1.0 6.0 3.3 2.8 5.9 3.2 0.0 1.8 112.1 110.4 55.04 29.16 46 1.196 3705K 5574 0.0 0.0 L5 1132/0 93.20 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/16 108.32 GB 0.0 11.9 5.6 6.2 14.5 8.3 3.5 5.2 102.8 125.8 118.20 63.58 107 1.105 7564K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.9 5.6 6.2 14.5 8.3 3.5 5.2 102.8 125.8 118.20 63.58 107 1.105 7564K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.9 5.6 6.2 11.7 5.5 0.0 0.0 118.4 117.2 102.60 55.46 68 1.509 7564K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 181.8 15.60 8.12 39 0.400 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.9 total, 16.7 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.52 GB write, 878.53 MB/s write, 11.87 GB read, 718.20 MB/s read, 118.2 seconds Interval compaction: 14.52 GB write, 888.86 MB/s write, 11.87 GB read, 726.64 MB/s read, 118.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 55, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 892963 Average: 12.2250 StdDev: 160.94 Min: 1 Median: 1.6531 Max: 43840 Percentiles: P50: 1.65 P75: 2.44 P99: 211.63 P99.9: 1267.37 P99.99: 3259.23 ------------------------------------------------------ [ 0, 1 ] 127804 14.312% 14.312% ### ( 1, 2 ] 487958 54.645% 68.957% ########### ( 2, 3 ] 122956 13.769% 82.727% ### ( 3, 4 ] 57286 6.415% 89.142% # ( 4, 6 ] 59216 6.631% 95.773% # ( 6, 10 ] 13115 1.469% 97.242% ( 10, 15 ] 2893 0.324% 97.566% ( 15, 22 ] 381 0.043% 97.609% ( 22, 34 ] 31 0.003% 97.612% ( 34, 51 ] 12 0.001% 97.613% ( 51, 76 ] 29 0.003% 97.617% ( 76, 110 ] 2026 0.227% 97.844% ( 110, 170 ] 8018 0.898% 98.741% ( 170, 250 ] 4436 0.497% 99.238% ( 250, 380 ] 2155 0.241% 99.480% ( 380, 580 ] 1977 0.221% 99.701% ( 580, 870 ] 1132 0.127% 99.828% ( 870, 1300 ] 698 0.078% 99.906% ( 1300, 1900 ] 414 0.046% 99.952% ( 1900, 2900 ] 273 0.031% 99.983% ( 2900, 4400 ] 266 0.030% 100.013% ( 4400, 6600 ] 94 0.011% 100.023% ( 6600, 9900 ] 23 0.003% 100.026% ( 9900, 14000 ] 7 0.001% 100.027% ( 14000, 22000 ] 13 0.001% 100.028% ( 22000, 33000 ] 6 0.001% 100.029% ( 33000, 50000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 199381 Average: 11.3513 StdDev: 146.38 Min: 1 Median: 2.4876 Max: 12927 Percentiles: P50: 2.49 P75: 3.80 P99: 21.16 P99.9: 2433.49 P99.99: 5974.67 ------------------------------------------------------ [ 0, 1 ] 3238 1.624% 1.624% ( 1, 2 ] 71433 35.827% 37.451% ####### ( 2, 3 ] 51309 25.734% 63.186% ##### ( 3, 4 ] 29546 14.819% 78.004% ### ( 4, 6 ] 30888 15.492% 93.496% ### ( 6, 10 ] 8287 4.156% 97.653% # ( 10, 15 ] 2019 1.013% 98.665% ( 15, 22 ] 758 0.380% 99.046% ( 22, 34 ] 72 0.036% 99.082% ( 34, 51 ] 11 0.006% 99.087% ( 51, 76 ] 11 0.006% 99.093% ( 76, 110 ] 108 0.054% 99.147% ( 110, 170 ] 514 0.258% 99.405% ( 170, 250 ] 255 0.128% 99.533% ( 250, 380 ] 128 0.064% 99.597% ( 380, 580 ] 143 0.072% 99.668% ( 580, 870 ] 164 0.082% 99.751% ( 870, 1300 ] 141 0.071% 99.821% ( 1300, 1900 ] 91 0.046% 99.867% ( 1900, 2900 ] 123 0.062% 99.929% ( 2900, 4400 ] 92 0.046% 99.975% ( 4400, 6600 ] 42 0.021% 99.996% ( 6600, 9900 ] 11 0.006% 100.002% ( 9900, 14000 ] 1 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 457256 Average: 15.7669 StdDev: 236.75 Min: 1 Median: 1.9255 Max: 35572 Percentiles: P50: 1.93 P75: 3.08 P99: 13.38 P99.9: 2400.62 P99.99: 3689.71 ------------------------------------------------------ [ 0, 1 ] 18863 4.125% 4.125% # ( 1, 2 ] 226662 49.570% 53.695% ########## ( 2, 3 ] 93470 20.442% 74.137% #### ( 3, 4 ] 46493 10.168% 84.305% ## ( 4, 6 ] 51712 11.309% 95.614% ## ( 6, 10 ] 13051 2.854% 98.468% # ( 10, 15 ] 3601 0.788% 99.256% ( 15, 22 ] 467 0.102% 99.358% ( 22, 34 ] 51 0.011% 99.369% ( 34, 51 ] 37 0.008% 99.377% ( 51, 76 ] 29 0.006% 99.383% ( 76, 110 ] 15 0.003% 99.387% ( 110, 170 ] 36 0.008% 99.394% ( 170, 250 ] 63 0.014% 99.408% ( 250, 380 ] 149 0.033% 99.441% ( 380, 580 ] 306 0.067% 99.508% ( 580, 870 ] 518 0.113% 99.621% ( 870, 1300 ] 600 0.131% 99.752% ( 1300, 1900 ] 478 0.105% 99.857% ( 1900, 2900 ] 395 0.086% 99.943% ( 2900, 4400 ] 407 0.089% 100.032% ( 4400, 6600 ] 129 0.028% 100.060% ( 6600, 9900 ] 43 0.009% 100.070% ( 9900, 14000 ] 5 0.001% 100.071% ( 14000, 22000 ] 13 0.003% 100.074% ( 22000, 33000 ] 7 0.002% 100.075% ( 33000, 50000 ] 1 0.000% 100.075% ** Level 3 read latency histogram (micros): Count: 922614 Average: 10.3425 StdDev: 152.27 Min: 1 Median: 1.9254 Max: 24967 Percentiles: P50: 1.93 P75: 3.07 P99: 10.94 P99.9: 1049.70 P99.99: 1609.61 ------------------------------------------------------ [ 0, 1 ] 30040 3.256% 3.256% # ( 1, 2 ] 466031 50.512% 53.768% ########## ( 2, 3 ] 189039 20.490% 74.257% #### ( 3, 4 ] 95105 10.308% 84.566% ## ( 4, 6 ] 109031 11.818% 96.383% ## ( 6, 10 ] 23136 2.508% 98.891% # ( 10, 15 ] 5336 0.578% 99.469% ( 15, 22 ] 622 0.067% 99.537% ( 22, 34 ] 61 0.007% 99.543% ( 34, 51 ] 45 0.005% 99.548% ( 51, 76 ] 90 0.010% 99.558% ( 76, 110 ] 172 0.019% 99.577% ( 110, 170 ] 517 0.056% 99.633% ( 170, 250 ] 389 0.042% 99.675% ( 250, 380 ] 344 0.037% 99.712% ( 380, 580 ] 538 0.058% 99.770% ( 580, 870 ] 813 0.088% 99.859% ( 870, 1300 ] 915 0.099% 99.958% ( 1300, 1900 ] 577 0.063% 100.020% ( 1900, 2900 ] 432 0.047% 100.067% ( 2900, 4400 ] 449 0.049% 100.116% ( 4400, 6600 ] 142 0.015% 100.131% ( 6600, 9900 ] 27 0.003% 100.134% ( 9900, 14000 ] 4 0.000% 100.135% ( 14000, 22000 ] 8 0.001% 100.135% ( 22000, 33000 ] 4 0.000% 100.136% ** Level 4 read latency histogram (micros): Count: 732772 Average: 25.5268 StdDev: 302.85 Min: 0 Median: 1.9229 Max: 45983 Percentiles: P50: 1.92 P75: 3.16 P99: 455.19 P99.9: 2594.60 P99.99: 3512.98 ------------------------------------------------------ [ 0, 1 ] 26613 3.632% 3.632% # ( 1, 2 ] 368174 50.244% 53.876% ########## ( 2, 3 ] 143215 19.544% 73.420% #### ( 3, 4 ] 74370 10.149% 83.569% ## ( 4, 6 ] 79247 10.815% 94.384% ## ( 6, 10 ] 18630 2.542% 96.926% # ( 10, 15 ] 4585 0.626% 97.552% ( 15, 22 ] 450 0.061% 97.613% ( 22, 34 ] 43 0.006% 97.619% ( 34, 51 ] 45 0.006% 97.625% ( 51, 76 ] 78 0.011% 97.636% ( 76, 110 ] 1308 0.179% 97.815% ( 110, 170 ] 4385 0.598% 98.413% ( 170, 250 ] 2270 0.310% 98.723% ( 250, 380 ] 1367 0.187% 98.909% ( 380, 580 ] 1767 0.241% 99.150% ( 580, 870 ] 1933 0.264% 99.414% ( 870, 1300 ] 1784 0.243% 99.658% ( 1300, 1900 ] 1148 0.157% 99.814% ( 1900, 2900 ] 903 0.123% 99.938% ( 2900, 4400 ] 939 0.128% 100.066% ( 4400, 6600 ] 313 0.043% 100.108% ( 6600, 9900 ] 87 0.012% 100.120% ( 9900, 14000 ] 11 0.002% 100.122% ( 14000, 22000 ] 38 0.005% 100.127% ( 22000, 33000 ] 12 0.002% 100.129% ( 33000, 50000 ] 7 0.001% 100.130% ** Level 5 read latency histogram (micros): Count: 87830 Average: 530.5343 StdDev: 1095.56 Min: 74 Median: 188.5946 Max: 46005 Percentiles: P50: 188.59 P75: 467.72 P99: 5010.79 P99.9: 9118.66 P99.99: 29905.12 ------------------------------------------------------ ( 51, 76 ] 6 0.007% 0.007% ( 76, 110 ] 8798 10.017% 10.024% ## ( 110, 170 ] 31671 36.059% 46.083% ####### ( 170, 250 ] 14800 16.851% 62.934% ### ( 250, 380 ] 7307 8.319% 71.254% ## ( 380, 580 ] 7502 8.542% 79.795% ## ( 580, 870 ] 5512 6.276% 86.071% # ( 870, 1300 ] 4296 4.891% 90.962% # ( 1300, 1900 ] 2581 2.939% 93.901% # ( 1900, 2900 ] 2038 2.320% 96.221% ( 2900, 4400 ] 2185 2.488% 98.709% ( 4400, 6600 ] 921 1.049% 99.757% ( 6600, 9900 ] 164 0.187% 99.944% ( 9900, 14000 ] 13 0.015% 99.959% ( 14000, 22000 ] 15 0.017% 99.976% ( 22000, 33000 ] 17 0.019% 99.995% ( 33000, 50000 ] 12 0.014% 100.009% ** DB Stats ** Uptime(secs): 16.9 total, 3.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 174.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.383 H:M:S, 31.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 275.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.122 H:M:S, 3.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-03:02:16 ... thread 0: (1000000,4000000) ops and (211900.8,186567.6) ops/second in (4.719189,21.439949) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.75 GB 50.3 3.3 0.0 3.3 7.0 3.7 0.0 1.9 97.8 210.1 34.16 23.74 67 0.510 3390K 3693 0.0 0.0 L1 23/23 1.74 GB 0.0 1.8 0.9 0.9 1.7 0.9 0.0 1.9 100.8 100.1 17.82 9.81 1 17.823 1824K 11K 0.0 0.0 L3 16/0 983.82 MB 1.0 3.6 2.4 1.2 3.5 2.4 0.3 1.5 101.7 101.0 35.89 17.05 14 2.563 1492K 3946 0.0 0.0 L4 172/0 9.64 GB 1.0 6.0 3.3 2.8 5.9 3.2 0.0 1.8 112.1 110.4 55.04 29.16 46 1.196 3705K 5574 0.0 0.0 L5 1132/0 93.20 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1362/40 109.29 GB 0.0 14.6 6.5 8.1 18.2 10.2 3.5 4.9 104.7 130.6 142.90 79.76 128 1.116 10M 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 6.5 8.1 18.2 10.2 3.5 4.9 104.7 130.6 142.90 79.76 128 1.116 10M 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 6.5 8.1 14.5 6.4 0.0 0.0 120.4 119.3 124.20 68.96 73 1.701 10M 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 205.4 18.71 10.80 55 0.340 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.6 total, 21.4 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.23 GB write, 862.52 MB/s write, 14.60 GB read, 691.15 MB/s read, 142.9 seconds Interval compaction: 18.23 GB write, 870.43 MB/s write, 14.60 GB read, 697.49 MB/s read, 142.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 55, interval: 61 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1152063 Average: 13.1733 StdDev: 144.98 Min: 1 Median: 1.6189 Max: 43840 Percentiles: P50: 1.62 P75: 2.37 P99: 232.22 P99.9: 1045.49 P99.99: 2470.22 ------------------------------------------------------ [ 0, 1 ] 194989 16.925% 16.925% ### ( 1, 2 ] 615709 53.444% 70.369% ########### ( 2, 3 ] 143402 12.447% 82.817% ## ( 3, 4 ] 71391 6.197% 89.013% # ( 4, 6 ] 67479 5.857% 94.871% # ( 6, 10 ] 14733 1.279% 96.150% ( 10, 15 ] 3289 0.285% 96.435% ( 15, 22 ] 428 0.037% 96.472% ( 22, 34 ] 38 0.003% 96.475% ( 34, 51 ] 14 0.001% 96.477% ( 51, 76 ] 34 0.003% 96.480% ( 76, 110 ] 4547 0.395% 96.874% ( 110, 170 ] 17954 1.558% 98.433% ( 170, 250 ] 8405 0.730% 99.162% ( 250, 380 ] 3626 0.315% 99.477% ( 380, 580 ] 3076 0.267% 99.744% ( 580, 870 ] 1490 0.129% 99.873% ( 870, 1300 ] 757 0.066% 99.939% ( 1300, 1900 ] 424 0.037% 99.976% ( 1900, 2900 ] 289 0.025% 100.001% ( 2900, 4400 ] 269 0.023% 100.024% ( 4400, 6600 ] 94 0.008% 100.032% ( 6600, 9900 ] 23 0.002% 100.034% ( 9900, 14000 ] 7 0.001% 100.035% ( 14000, 22000 ] 13 0.001% 100.036% ( 22000, 33000 ] 6 0.001% 100.037% ( 33000, 50000 ] 1 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 233608 Average: 11.7392 StdDev: 137.55 Min: 1 Median: 2.5221 Max: 12927 Percentiles: P50: 2.52 P75: 3.83 P99: 145.86 P99.9: 2151.14 P99.99: 5638.24 ------------------------------------------------------ [ 0, 1 ] 3991 1.708% 1.708% ( 1, 2 ] 80754 34.568% 36.277% ####### ( 2, 3 ] 61409 26.287% 62.564% ##### ( 3, 4 ] 35163 15.052% 77.616% ### ( 4, 6 ] 35966 15.396% 93.012% ### ( 6, 10 ] 9462 4.050% 97.062% # ( 10, 15 ] 2378 1.018% 98.080% ( 15, 22 ] 906 0.388% 98.468% ( 22, 34 ] 87 0.037% 98.505% ( 34, 51 ] 15 0.006% 98.512% ( 51, 76 ] 11 0.005% 98.516% ( 76, 110 ] 338 0.145% 98.661% ( 110, 170 ] 1325 0.567% 99.228% ( 170, 250 ] 532 0.228% 99.456% ( 250, 380 ] 282 0.121% 99.577% ( 380, 580 ] 244 0.104% 99.681% ( 580, 870 ] 223 0.095% 99.777% ( 870, 1300 ] 163 0.070% 99.846% ( 1300, 1900 ] 94 0.040% 99.887% ( 1900, 2900 ] 125 0.054% 99.940% ( 2900, 4400 ] 93 0.040% 99.980% ( 4400, 6600 ] 42 0.018% 99.998% ( 6600, 9900 ] 11 0.005% 100.003% ( 9900, 14000 ] 1 0.000% 100.003% ** Level 2 read latency histogram (micros): Count: 457256 Average: 15.7669 StdDev: 236.75 Min: 1 Median: 1.9255 Max: 35572 Percentiles: P50: 1.93 P75: 3.08 P99: 13.38 P99.9: 2400.62 P99.99: 3689.71 ------------------------------------------------------ [ 0, 1 ] 18863 4.125% 4.125% # ( 1, 2 ] 226662 49.570% 53.695% ########## ( 2, 3 ] 93470 20.442% 74.137% #### ( 3, 4 ] 46493 10.168% 84.305% ## ( 4, 6 ] 51712 11.309% 95.614% ## ( 6, 10 ] 13051 2.854% 98.468% # ( 10, 15 ] 3601 0.788% 99.256% ( 15, 22 ] 467 0.102% 99.358% ( 22, 34 ] 51 0.011% 99.369% ( 34, 51 ] 37 0.008% 99.377% ( 51, 76 ] 29 0.006% 99.383% ( 76, 110 ] 15 0.003% 99.387% ( 110, 170 ] 36 0.008% 99.394% ( 170, 250 ] 63 0.014% 99.408% ( 250, 380 ] 149 0.033% 99.441% ( 380, 580 ] 306 0.067% 99.508% ( 580, 870 ] 518 0.113% 99.621% ( 870, 1300 ] 600 0.131% 99.752% ( 1300, 1900 ] 478 0.105% 99.857% ( 1900, 2900 ] 395 0.086% 99.943% ( 2900, 4400 ] 407 0.089% 100.032% ( 4400, 6600 ] 129 0.028% 100.060% ( 6600, 9900 ] 43 0.009% 100.070% ( 9900, 14000 ] 5 0.001% 100.071% ( 14000, 22000 ] 13 0.003% 100.074% ( 22000, 33000 ] 7 0.002% 100.075% ( 33000, 50000 ] 1 0.000% 100.075% ** Level 3 read latency histogram (micros): Count: 923614 Average: 10.5349 StdDev: 152.36 Min: 1 Median: 1.9265 Max: 24967 Percentiles: P50: 1.93 P75: 3.08 P99: 11.87 P99.9: 1050.05 P99.99: 1609.50 ------------------------------------------------------ [ 0, 1 ] 30040 3.252% 3.252% # ( 1, 2 ] 466031 50.457% 53.710% ########## ( 2, 3 ] 189039 20.467% 74.177% #### ( 3, 4 ] 95105 10.297% 84.474% ## ( 4, 6 ] 109031 11.805% 96.279% ## ( 6, 10 ] 23136 2.505% 98.784% # ( 10, 15 ] 5336 0.578% 99.362% ( 15, 22 ] 622 0.067% 99.429% ( 22, 34 ] 61 0.007% 99.436% ( 34, 51 ] 45 0.005% 99.440% ( 51, 76 ] 90 0.010% 99.450% ( 76, 110 ] 337 0.036% 99.487% ( 110, 170 ] 1026 0.111% 99.598% ( 170, 250 ] 561 0.061% 99.659% ( 250, 380 ] 412 0.045% 99.703% ( 380, 580 ] 602 0.065% 99.768% ( 580, 870 ] 832 0.090% 99.858% ( 870, 1300 ] 918 0.099% 99.958% ( 1300, 1900 ] 577 0.062% 100.020% ( 1900, 2900 ] 432 0.047% 100.067% ( 2900, 4400 ] 449 0.049% 100.116% ( 4400, 6600 ] 142 0.015% 100.131% ( 6600, 9900 ] 27 0.003% 100.134% ( 9900, 14000 ] 4 0.000% 100.134% ( 14000, 22000 ] 8 0.001% 100.135% ( 22000, 33000 ] 4 0.000% 100.136% ** Level 4 read latency histogram (micros): Count: 743025 Average: 27.6852 StdDev: 301.79 Min: 0 Median: 1.9367 Max: 45983 Percentiles: P50: 1.94 P75: 3.26 P99: 495.89 P99.9: 2586.44 P99.99: 3511.63 ------------------------------------------------------ [ 0, 1 ] 26613 3.582% 3.582% # ( 1, 2 ] 368203 49.555% 53.136% ########## ( 2, 3 ] 143328 19.290% 72.426% #### ( 3, 4 ] 74429 10.017% 82.443% ## ( 4, 6 ] 79358 10.680% 93.124% ## ( 6, 10 ] 18642 2.509% 95.632% # ( 10, 15 ] 4590 0.618% 96.250% ( 15, 22 ] 450 0.061% 96.311% ( 22, 34 ] 43 0.006% 96.317% ( 34, 51 ] 45 0.006% 96.323% ( 51, 76 ] 80 0.011% 96.333% ( 76, 110 ] 2846 0.383% 96.716% ( 110, 170 ] 9601 1.292% 98.009% ( 170, 250 ] 4025 0.542% 98.550% ( 250, 380 ] 2031 0.273% 98.824% ( 380, 580 ] 2262 0.304% 99.128% ( 580, 870 ] 2143 0.288% 99.416% ( 870, 1300 ] 1817 0.245% 99.661% ( 1300, 1900 ] 1152 0.155% 99.816% ( 1900, 2900 ] 909 0.122% 99.938% ( 2900, 4400 ] 941 0.127% 100.065% ( 4400, 6600 ] 313 0.042% 100.107% ( 6600, 9900 ] 87 0.012% 100.119% ( 9900, 14000 ] 11 0.001% 100.120% ( 14000, 22000 ] 38 0.005% 100.125% ( 22000, 33000 ] 12 0.002% 100.127% ( 33000, 50000 ] 7 0.001% 100.128% ** Level 5 read latency histogram (micros): Count: 151842 Average: 385.3739 StdDev: 854.90 Min: 74 Median: 162.2870 Max: 46005 Percentiles: P50: 162.29 P75: 291.57 P99: 4136.46 P99.9: 7830.62 P99.99: 25763.16 ------------------------------------------------------ ( 51, 76 ] 8 0.005% 0.005% ( 76, 110 ] 19064 12.555% 12.560% ### ( 110, 170 ] 65235 42.962% 55.523% ######### ( 170, 250 ] 25858 17.030% 72.552% ### ( 250, 380 ] 11623 7.655% 80.207% ## ( 380, 580 ] 10899 7.178% 87.385% # ( 580, 870 ] 6667 4.391% 91.776% # ( 870, 1300 ] 4481 2.951% 94.727% # ( 1300, 1900 ] 2619 1.725% 96.452% ( 1900, 2900 ] 2066 1.361% 97.812% ( 2900, 4400 ] 2188 1.441% 99.253% ( 4400, 6600 ] 921 0.607% 99.860% ( 6600, 9900 ] 164 0.108% 99.968% ( 9900, 14000 ] 13 0.009% 99.976% ( 14000, 22000 ] 15 0.010% 99.986% ( 22000, 33000 ] 17 0.011% 99.997% ( 33000, 50000 ] 12 0.008% 100.005% ** DB Stats ** Uptime(secs): 21.6 total, 4.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 181.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.578 H:M:S, 30.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 208.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.196 H:M:S, 25.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 232.137 micros/op 17209 ops/sec 60.140 seconds 1034996 operations; 16.7 MB/s (256999 of 256999 found) Microseconds per read: Count: 1034996 Average: 232.1398 StdDev: 772.28 Min: 2 Median: 165.5696 Max: 217128 Percentiles: P50: 165.57 P75: 225.87 P99: 1108.39 P99.9: 11243.98 P99.99: 30784.00 ------------------------------------------------------ ( 1, 2 ] 8 0.001% 0.001% ( 2, 3 ] 46 0.004% 0.005% ( 3, 4 ] 71 0.007% 0.012% ( 4, 6 ] 110 0.011% 0.023% ( 6, 10 ] 639 0.062% 0.084% ( 10, 15 ] 6135 0.593% 0.677% ( 15, 22 ] 4594 0.444% 1.121% ( 22, 34 ] 8513 0.823% 1.944% ( 34, 51 ] 2700 0.261% 2.204% ( 51, 76 ] 375 0.036% 2.241% ( 76, 110 ] 29907 2.890% 5.130% # ( 110, 170 ] 501425 48.447% 53.577% ########## ( 170, 250 ] 317514 30.678% 84.255% ###### ( 250, 380 ] 101658 9.822% 94.077% ## ( 380, 580 ] 35057 3.387% 97.464% # ( 580, 870 ] 12800 1.237% 98.701% ( 870, 1300 ] 5581 0.539% 99.240% ( 1300, 1900 ] 2620 0.253% 99.493% ( 1900, 2900 ] 1799 0.174% 99.667% ( 2900, 4400 ] 1503 0.145% 99.812% ( 4400, 6600 ] 519 0.050% 99.863% ( 6600, 9900 ] 249 0.024% 99.887% ( 9900, 14000 ] 421 0.041% 99.927% ( 14000, 22000 ] 484 0.047% 99.974% ( 22000, 33000 ] 206 0.020% 99.994% ( 33000, 50000 ] 47 0.005% 99.999% ( 50000, 75000 ] 12 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18503788 rocksdb.bloom.filter.full.positive COUNT : 1214979 rocksdb.bloom.filter.full.true.positive COUNT : 1034551 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 445 rocksdb.memtable.miss COUNT : 1034551 rocksdb.l0.hit COUNT : 40221 rocksdb.l1.hit COUNT : 16957 rocksdb.l2andup.hit COUNT : 977373 rocksdb.compaction.key.drop.new COUNT : 174856 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4256183 rocksdb.number.keys.read COUNT : 1034996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4392380856 rocksdb.bytes.read COUNT : 1034996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1600 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43116948 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18966368467 rocksdb.compact.write.bytes COUNT : 18785741047 rocksdb.flush.write.bytes COUNT : 4359871649 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 30 rocksdb.number.superversion_acquires COUNT : 859 rocksdb.number.superversion_releases COUNT : 834 rocksdb.number.superversion_cleanups COUNT : 215 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 223 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4324635648 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1606656 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 23073870366 rocksdb.non.last.level.read.count COUNT : 5432850 rocksdb.block.checksum.compute.count COUNT : 5821331 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 164.898094 P95 : 433.015344 P99 : 1107.199137 P100 : 217126.000000 COUNT : 1034996 SUM : 239518569 rocksdb.db.write.micros P50 : 1.549575 P95 : 4.867542 P99 : 12.695540 P100 : 980405.000000 COUNT : 4256183 SUM : 54304588 rocksdb.compaction.times.micros P50 : 1361538.461538 P95 : 3460000.000000 P99 : 15920000.000000 P100 : 17823441.000000 COUNT : 76 SUM : 129039483 rocksdb.compaction.times.cpu_micros P50 : 802000.000000 P95 : 1837777.777778 P99 : 9805836.000000 P100 : 9805836.000000 COUNT : 76 SUM : 73734741 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 785.806452 P95 : 75000.000000 P99 : 302000.000000 P100 : 312877.000000 COUNT : 60 SUM : 909311 rocksdb.compaction.outfile.sync.micros P50 : 49055.555556 P95 : 248857.142857 P99 : 463600.000000 P100 : 543308.000000 COUNT : 224 SUM : 16905836 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 520.000000 P95 : 3991.250000 P99 : 5522.000000 P100 : 6629.000000 COUNT : 149 SUM : 172489 rocksdb.table.open.io.micros P50 : 9237.020316 P95 : 20976.744186 P99 : 29750.000000 P100 : 140745.000000 COUNT : 1600 SUM : 15623386 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.982961 P95 : 18.352675 P99 : 195.838622 P100 : 45989.000000 COUNT : 4593222 SUM : 83085186 rocksdb.read.block.get.micros P50 : 136.173466 P95 : 298.983804 P99 : 1035.119835 P100 : 46011.000000 COUNT : 1226497 SUM : 203819316 rocksdb.write.raw.block.micros P50 : 0.542388 P95 : 1.482340 P99 : 3.721618 P100 : 62931.000000 COUNT : 5606072 SUM : 18365330 rocksdb.numfiles.in.singlecompaction P50 : 2.639535 P95 : 3.942593 P99 : 35.530000 P100 : 36.000000 COUNT : 91 SUM : 322 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.575144 P95 : 1298.121372 P99 : 2699.576090 P100 : 980248.000000 COUNT : 198457 SUM : 43138075 rocksdb.sst.read.micros P50 : 2.432593 P95 : 167.044351 P99 : 462.672706 P100 : 46005.000000 COUNT : 5432876 SUM : 269548087 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1034996 SUM : 1034996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4256183 SUM : 4392380856 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 223333.333333 P95 : 1064000.000000 P99 : 1214710.000000 P100 : 1214710.000000 COUNT : 60 SUM : 19742165 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 251 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0