[2024-12-04 22:04:13.477540] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-04 22:04:13.477798] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2367645 ] Set seed to 1733346253470874 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-04 22:04:13.591403] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-04 22:04:13.797963] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-04 22:04:13.798005] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2367645' to capture a snapshot of events at runtime. [2024-12-04 22:04:13.798015] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2367645 for offline analysis/debug. [2024-12-04 22:04:13.798038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Dec 4 22:04:22 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/04-22:04:29 ... thread 0: (1000000,1000000) ops and (135059.2,135059.2) ops/second in (7.404158,7.404158) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.30 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 42.5 134.6 8.89 3.93 10 0.889 383K 501 0.0 0.0 L1 4/4 292.21 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 128.78 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 40/9 2.89 GB 2.3 2.9 2.0 0.9 2.9 2.0 0.1 1.4 96.1 95.0 31.40 14.15 11 2.855 1329K 0 0.0 0.0 L4 187/11 12.07 GB 1.2 2.8 2.4 0.4 2.8 2.4 0.0 1.1 107.2 106.5 26.52 13.30 23 1.153 1882K 0 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1319/33 105.13 GB 0.0 6.1 4.4 1.7 6.8 5.2 0.1 8.6 93.3 104.8 66.81 31.38 44 1.518 3595K 501 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 4.4 1.7 6.8 5.2 0.1 8.6 93.3 104.8 66.81 31.38 44 1.518 3595K 501 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 4.4 1.7 6.0 4.4 0.0 0.0 103.9 103.0 60.05 29.02 35 1.716 3595K 501 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 121.1 6.76 2.36 9 0.751 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.6 total, 7.4 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.84 GB write, 926.24 MB/s write, 6.09 GB read, 824.71 MB/s read, 66.8 seconds Interval compaction: 6.84 GB write, 945.73 MB/s write, 6.09 GB read, 842.07 MB/s read, 66.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 247466 Average: 18.4218 StdDev: 209.68 Min: 1 Median: 1.8954 Max: 11471 Percentiles: P50: 1.90 P75: 2.94 P99: 14.15 P99.9: 3520.07 P99.99: 5588.79 ------------------------------------------------------ [ 0, 1 ] 9966 4.027% 4.027% # ( 1, 2 ] 127061 51.345% 55.372% ########## ( 2, 3 ] 51892 20.969% 76.341% #### ( 3, 4 ] 21440 8.664% 85.005% ## ( 4, 6 ] 27147 10.970% 95.975% ## ( 6, 10 ] 6038 2.440% 98.415% ( 10, 15 ] 1744 0.705% 99.120% ( 15, 22 ] 197 0.080% 99.199% ( 22, 34 ] 11 0.004% 99.204% ( 34, 51 ] 6 0.002% 99.206% ( 51, 76 ] 3 0.001% 99.208% ( 76, 110 ] 3 0.001% 99.209% ( 110, 170 ] 9 0.004% 99.212% ( 170, 250 ] 24 0.010% 99.222% ( 250, 380 ] 44 0.018% 99.240% ( 380, 580 ] 112 0.045% 99.285% ( 580, 870 ] 237 0.096% 99.381% ( 870, 1300 ] 353 0.143% 99.524% ( 1300, 1900 ] 409 0.165% 99.689% ( 1900, 2900 ] 402 0.162% 99.851% ( 2900, 4400 ] 294 0.119% 99.970% ( 4400, 6600 ] 93 0.038% 100.008% ( 6600, 9900 ] 9 0.004% 100.011% ( 9900, 14000 ] 2 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 49636 Average: 16.8397 StdDev: 208.98 Min: 1 Median: 2.1609 Max: 11134 Percentiles: P50: 2.16 P75: 3.27 P99: 13.62 P99.9: 3593.79 P99.99: 7284.02 ------------------------------------------------------ [ 0, 1 ] 619 1.247% 1.247% ( 1, 2 ] 22090 44.504% 45.751% ######### ( 2, 3 ] 13104 26.400% 72.151% ##### ( 3, 4 ] 5218 10.513% 82.664% ## ( 4, 6 ] 6330 12.753% 95.417% ### ( 6, 10 ] 1454 2.929% 98.346% # ( 10, 15 ] 449 0.905% 99.251% ( 15, 22 ] 35 0.071% 99.321% ( 22, 34 ] 8 0.016% 99.337% ( 34, 51 ] 4 0.008% 99.345% ( 51, 76 ] 5 0.010% 99.355% ( 76, 110 ] 1 0.002% 99.357% ( 110, 170 ] 3 0.006% 99.363% ( 170, 250 ] 4 0.008% 99.371% ( 250, 380 ] 3 0.006% 99.377% ( 380, 580 ] 17 0.034% 99.412% ( 580, 870 ] 36 0.073% 99.484% ( 870, 1300 ] 50 0.101% 99.585% ( 1300, 1900 ] 56 0.113% 99.698% ( 1900, 2900 ] 74 0.149% 99.847% ( 2900, 4400 ] 57 0.115% 99.962% ( 4400, 6600 ] 13 0.026% 99.988% ( 6600, 9900 ] 5 0.010% 99.998% ( 9900, 14000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 326565 Average: 19.0057 StdDev: 222.26 Min: 1 Median: 1.9507 Max: 10763 Percentiles: P50: 1.95 P75: 3.06 P99: 13.92 P99.9: 2714.60 P99.99: 3637.70 ------------------------------------------------------ [ 0, 1 ] 11672 3.574% 3.574% # ( 1, 2 ] 159467 48.832% 52.406% ########## ( 2, 3 ] 71778 21.980% 74.385% #### ( 3, 4 ] 30961 9.481% 83.866% ## ( 4, 6 ] 37642 11.527% 95.393% ## ( 6, 10 ] 9490 2.906% 98.299% # ( 10, 15 ] 2921 0.894% 99.193% ( 15, 22 ] 450 0.138% 99.331% ( 22, 34 ] 46 0.014% 99.345% ( 34, 51 ] 18 0.006% 99.351% ( 51, 76 ] 11 0.003% 99.354% ( 76, 110 ] 7 0.002% 99.356% ( 110, 170 ] 8 0.002% 99.359% ( 170, 250 ] 18 0.006% 99.364% ( 250, 380 ] 64 0.020% 99.384% ( 380, 580 ] 112 0.034% 99.418% ( 580, 870 ] 244 0.075% 99.493% ( 870, 1300 ] 373 0.114% 99.607% ( 1300, 1900 ] 497 0.152% 99.759% ( 1900, 2900 ] 564 0.173% 99.932% ( 2900, 4400 ] 385 0.118% 100.050% ( 4400, 6600 ] 168 0.051% 100.101% ( 6600, 9900 ] 27 0.008% 100.110% ( 9900, 14000 ] 4 0.001% 100.111% ** Level 3 read latency histogram (micros): Count: 719804 Average: 14.5820 StdDev: 177.57 Min: 1 Median: 2.0321 Max: 10131 Percentiles: P50: 2.03 P75: 3.08 P99: 11.41 P99.9: 1436.37 P99.99: 1841.26 ------------------------------------------------------ [ 0, 1 ] 13035 1.811% 1.811% ( 1, 2 ] 341078 47.385% 49.196% ######### ( 2, 3 ] 180351 25.056% 74.251% ##### ( 3, 4 ] 71726 9.965% 84.216% ## ( 4, 6 ] 86697 12.045% 96.261% ## ( 6, 10 ] 18175 2.525% 98.786% # ( 10, 15 ] 5458 0.758% 99.544% ( 15, 22 ] 611 0.085% 99.629% ( 22, 34 ] 45 0.006% 99.635% ( 34, 51 ] 30 0.004% 99.639% ( 51, 76 ] 40 0.006% 99.645% ( 76, 110 ] 16 0.002% 99.647% ( 110, 170 ] 24 0.003% 99.650% ( 170, 250 ] 41 0.006% 99.656% ( 250, 380 ] 93 0.013% 99.669% ( 380, 580 ] 226 0.031% 99.700% ( 580, 870 ] 461 0.064% 99.764% ( 870, 1300 ] 759 0.105% 99.870% ( 1300, 1900 ] 960 0.133% 100.003% ( 1900, 2900 ] 908 0.126% 100.129% ( 2900, 4400 ] 652 0.091% 100.220% ( 4400, 6600 ] 177 0.025% 100.244% ( 6600, 9900 ] 27 0.004% 100.248% ( 9900, 14000 ] 1 0.000% 100.248% ** Level 4 read latency histogram (micros): Count: 133808 Average: 57.9701 StdDev: 396.48 Min: 1 Median: 1.9753 Max: 9594 Percentiles: P50: 1.98 P75: 3.11 P99: 2060.68 P99.9: 4446.58 P99.99: 5784.66 ------------------------------------------------------ [ 0, 1 ] 3613 2.700% 2.700% # ( 1, 2 ] 64891 48.496% 51.196% ########## ( 2, 3 ] 30463 22.766% 73.962% ##### ( 3, 4 ] 12925 9.659% 83.621% ## ( 4, 6 ] 13976 10.445% 94.066% ## ( 6, 10 ] 3252 2.430% 96.496% ( 10, 15 ] 908 0.679% 97.175% ( 15, 22 ] 101 0.075% 97.251% ( 22, 34 ] 2 0.001% 97.252% ( 34, 51 ] 6 0.004% 97.257% ( 51, 76 ] 12 0.009% 97.265% ( 76, 110 ] 6 0.004% 97.270% ( 110, 170 ] 14 0.010% 97.280% ( 170, 250 ] 73 0.055% 97.335% ( 250, 380 ] 73 0.055% 97.390% ( 380, 580 ] 224 0.167% 97.557% ( 580, 870 ] 414 0.309% 97.866% ( 870, 1300 ] 613 0.458% 98.324% ( 1300, 1900 ] 781 0.584% 98.908% ( 1900, 2900 ] 765 0.572% 99.480% ( 2900, 4400 ] 558 0.417% 99.897% ( 4400, 6600 ] 198 0.148% 100.045% ( 6600, 9900 ] 30 0.022% 100.067% ** Level 5 read latency histogram (micros): Count: 9000 Average: 2339.5594 StdDev: 1731.30 Min: 91 Median: 1827.5382 Max: 14532 Percentiles: P50: 1827.54 P75: 3363.02 P99: 8652.24 P99.9: 11608.33 P99.99: 14532.00 ------------------------------------------------------ ( 76, 110 ] 3 0.033% 0.033% ( 110, 170 ] 26 0.289% 0.322% ( 170, 250 ] 65 0.722% 1.044% ( 250, 380 ] 222 2.467% 3.511% ( 380, 580 ] 478 5.311% 8.822% # ( 580, 870 ] 989 10.989% 19.811% ## ( 870, 1300 ] 1392 15.467% 35.278% ### ( 1300, 1900 ] 1507 16.744% 52.022% ### ( 1900, 2900 ] 1588 17.644% 69.667% #### ( 2900, 4400 ] 1555 17.278% 86.944% ### ( 4400, 6600 ] 960 10.667% 97.611% ## ( 6600, 9900 ] 201 2.233% 99.844% ( 9900, 14000 ] 12 0.133% 99.978% ( 14000, 22000 ] 2 0.022% 100.000% ** DB Stats ** Uptime(secs): 7.6 total, 7.4 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 130.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.542 H:M:S, 46.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 132.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.542 H:M:S, 47.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/04-22:04:35 ... thread 0: (1000000,2000000) ops and (170006.4,150531.1) ops/second in (5.882131,13.286289) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 1.84 GB 31.5 1.0 0.0 1.0 2.9 1.8 0.0 1.6 56.3 155.5 19.03 9.83 26 0.732 1087K 1408 0.0 0.0 L1 6/6 560.73 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.0 1.6 84.3 84.0 9.49 3.87 1 9.493 812K 2300 0.0 0.0 L2 1/0 47.43 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 14/1 1003.49 MB 0.9 3.1 2.1 1.0 3.1 2.1 0.3 1.5 96.9 95.9 33.14 15.07 12 2.762 1390K 0 0.0 0.0 L4 173/7 10.30 GB 1.0 6.8 4.5 2.3 6.7 4.4 0.2 1.5 114.0 112.7 61.02 33.20 45 1.356 3443K 5105 0.0 0.0 L5 1124/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1332/24 106.11 GB 0.0 11.8 7.1 4.7 13.5 8.8 4.6 7.3 98.1 112.6 122.68 61.96 84 1.461 6734K 8813 0.0 0.0 Int 0/0 0.00 KB 0.0 11.8 7.1 4.7 13.5 8.8 4.6 7.3 98.1 112.6 122.68 61.96 84 1.461 6734K 8813 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.8 7.1 4.7 11.6 7.0 0.0 0.0 109.4 108.3 110.09 56.54 61 1.805 6734K 8813 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 150.1 12.59 5.42 23 0.547 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.4 total, 13.3 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.49 GB write, 1027.69 MB/s write, 11.76 GB read, 895.57 MB/s read, 122.7 seconds Interval compaction: 13.49 GB write, 1039.74 MB/s write, 11.76 GB read, 906.07 MB/s read, 122.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 39, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 552678 Average: 15.2463 StdDev: 207.13 Min: 1 Median: 1.8209 Max: 62219 Percentiles: P50: 1.82 P75: 2.77 P99: 14.22 P99.9: 2863.44 P99.99: 4617.52 ------------------------------------------------------ [ 0, 1 ] 30001 5.428% 5.428% # ( 1, 2 ] 300076 54.295% 59.723% ########### ( 2, 3 ] 109086 19.738% 79.461% #### ( 3, 4 ] 43008 7.782% 87.243% ## ( 4, 6 ] 51558 9.329% 96.571% ## ( 6, 10 ] 10902 1.973% 98.544% ( 10, 15 ] 2987 0.540% 99.084% ( 15, 22 ] 326 0.059% 99.143% ( 22, 34 ] 21 0.004% 99.147% ( 34, 51 ] 12 0.002% 99.149% ( 51, 76 ] 12 0.002% 99.152% ( 76, 110 ] 23 0.004% 99.156% ( 110, 170 ] 226 0.041% 99.197% ( 170, 250 ] 325 0.059% 99.255% ( 250, 380 ] 334 0.060% 99.316% ( 380, 580 ] 522 0.094% 99.410% ( 580, 870 ] 724 0.131% 99.541% ( 870, 1300 ] 759 0.137% 99.679% ( 1300, 1900 ] 654 0.118% 99.797% ( 1900, 2900 ] 593 0.107% 99.904% ( 2900, 4400 ] 461 0.083% 99.988% ( 4400, 6600 ] 149 0.027% 100.015% ( 6600, 9900 ] 16 0.003% 100.018% ( 9900, 14000 ] 3 0.001% 100.018% ( 22000, 33000 ] 1 0.000% 100.018% ( 33000, 50000 ] 1 0.000% 100.018% ( 50000, 75000 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 74714 Average: 20.0817 StdDev: 267.08 Min: 1 Median: 2.2434 Max: 30371 Percentiles: P50: 2.24 P75: 3.42 P99: 248.96 P99.9: 3547.96 P99.99: 8928.88 ------------------------------------------------------ [ 0, 1 ] 793 1.061% 1.061% ( 1, 2 ] 31651 42.363% 43.424% ######## ( 2, 3 ] 20182 27.012% 70.437% ##### ( 3, 4 ] 8028 10.745% 81.182% ## ( 4, 6 ] 9938 13.301% 94.483% ### ( 6, 10 ] 2432 3.255% 97.738% # ( 10, 15 ] 686 0.918% 98.656% ( 15, 22 ] 68 0.091% 98.747% ( 22, 34 ] 11 0.015% 98.762% ( 34, 51 ] 6 0.008% 98.770% ( 51, 76 ] 7 0.009% 98.779% ( 76, 110 ] 13 0.017% 98.797% ( 110, 170 ] 65 0.087% 98.884% ( 170, 250 ] 88 0.118% 99.002% ( 250, 380 ] 82 0.110% 99.111% ( 380, 580 ] 105 0.141% 99.252% ( 580, 870 ] 124 0.166% 99.418% ( 870, 1300 ] 120 0.161% 99.578% ( 1300, 1900 ] 102 0.137% 99.715% ( 1900, 2900 ] 102 0.137% 99.851% ( 2900, 4400 ] 84 0.112% 99.964% ( 4400, 6600 ] 16 0.021% 99.985% ( 6600, 9900 ] 5 0.007% 99.992% ( 9900, 14000 ] 1 0.001% 99.993% ( 14000, 22000 ] 4 0.005% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 391962 Average: 17.6339 StdDev: 212.74 Min: 1 Median: 1.9662 Max: 10763 Percentiles: P50: 1.97 P75: 3.10 P99: 13.57 P99.9: 2688.65 P99.99: 3700.48 ------------------------------------------------------ [ 0, 1 ] 12717 3.244% 3.244% # ( 1, 2 ] 189676 48.391% 51.636% ########## ( 2, 3 ] 87989 22.448% 74.084% #### ( 3, 4 ] 37772 9.637% 83.721% ## ( 4, 6 ] 46006 11.737% 95.458% ## ( 6, 10 ] 11473 2.927% 98.385% # ( 10, 15 ] 3378 0.862% 99.247% ( 15, 22 ] 500 0.128% 99.375% ( 22, 34 ] 48 0.012% 99.387% ( 34, 51 ] 20 0.005% 99.392% ( 51, 76 ] 16 0.004% 99.396% ( 76, 110 ] 9 0.002% 99.398% ( 110, 170 ] 8 0.002% 99.400% ( 170, 250 ] 19 0.005% 99.405% ( 250, 380 ] 74 0.019% 99.424% ( 380, 580 ] 133 0.034% 99.458% ( 580, 870 ] 288 0.073% 99.532% ( 870, 1300 ] 433 0.110% 99.642% ( 1300, 1900 ] 541 0.138% 99.780% ( 1900, 2900 ] 596 0.152% 99.932% ( 2900, 4400 ] 425 0.108% 100.041% ( 4400, 6600 ] 179 0.046% 100.086% ( 6600, 9900 ] 32 0.008% 100.094% ( 9900, 14000 ] 5 0.001% 100.096% ** Level 3 read latency histogram (micros): Count: 1150799 Average: 13.6032 StdDev: 193.18 Min: 1 Median: 2.0034 Max: 46989 Percentiles: P50: 2.00 P75: 3.05 P99: 11.54 P99.9: 1429.08 P99.99: 1899.51 ------------------------------------------------------ [ 0, 1 ] 21678 1.884% 1.884% ( 1, 2 ] 552765 48.033% 49.917% ########## ( 2, 3 ] 283114 24.602% 74.518% ##### ( 3, 4 ] 112303 9.759% 84.277% ## ( 4, 6 ] 136685 11.877% 96.154% ## ( 6, 10 ] 30101 2.616% 98.770% # ( 10, 15 ] 8603 0.748% 99.518% ( 15, 22 ] 940 0.082% 99.599% ( 22, 34 ] 73 0.006% 99.606% ( 34, 51 ] 51 0.004% 99.610% ( 51, 76 ] 88 0.008% 99.618% ( 76, 110 ] 28 0.002% 99.620% ( 110, 170 ] 80 0.007% 99.627% ( 170, 250 ] 121 0.011% 99.638% ( 250, 380 ] 218 0.019% 99.657% ( 380, 580 ] 467 0.041% 99.697% ( 580, 870 ] 851 0.074% 99.771% ( 870, 1300 ] 1198 0.104% 99.875% ( 1300, 1900 ] 1321 0.115% 99.990% ( 1900, 2900 ] 1170 0.102% 100.092% ( 2900, 4400 ] 887 0.077% 100.169% ( 4400, 6600 ] 254 0.022% 100.191% ( 6600, 9900 ] 36 0.003% 100.194% ( 9900, 14000 ] 9 0.001% 100.195% ( 14000, 22000 ] 6 0.001% 100.195% ( 22000, 33000 ] 5 0.000% 100.196% ( 33000, 50000 ] 3 0.000% 100.196% ** Level 4 read latency histogram (micros): Count: 747032 Average: 21.8244 StdDev: 260.06 Min: 0 Median: 1.9301 Max: 81031 Percentiles: P50: 1.93 P75: 2.95 P99: 315.75 P99.9: 2545.89 P99.99: 3322.58 ------------------------------------------------------ [ 0, 1 ] 21417 2.867% 2.867% # ( 1, 2 ] 378566 50.676% 53.543% ########## ( 2, 3 ] 168041 22.494% 76.037% #### ( 3, 4 ] 67087 8.980% 85.018% ## ( 4, 6 ] 77675 10.398% 95.416% ## ( 6, 10 ] 19283 2.581% 97.997% # ( 10, 15 ] 4908 0.657% 98.654% ( 15, 22 ] 510 0.068% 98.722% ( 22, 34 ] 34 0.005% 98.727% ( 34, 51 ] 37 0.005% 98.732% ( 51, 76 ] 77 0.010% 98.742% ( 76, 110 ] 54 0.007% 98.749% ( 110, 170 ] 558 0.075% 98.824% ( 170, 250 ] 906 0.121% 98.945% ( 250, 380 ] 810 0.108% 99.054% ( 380, 580 ] 1117 0.150% 99.203% ( 580, 870 ] 1527 0.204% 99.408% ( 870, 1300 ] 1541 0.206% 99.614% ( 1300, 1900 ] 1370 0.183% 99.797% ( 1900, 2900 ] 1189 0.159% 99.956% ( 2900, 4400 ] 892 0.119% 100.076% ( 4400, 6600 ] 274 0.037% 100.113% ( 6600, 9900 ] 43 0.006% 100.118% ( 9900, 14000 ] 7 0.001% 100.119% ( 14000, 22000 ] 7 0.001% 100.120% ( 22000, 33000 ] 3 0.000% 100.121% ( 33000, 50000 ] 4 0.001% 100.121% ( 75000, 110000 ] 1 0.000% 100.121% ** Level 5 read latency histogram (micros): Count: 32540 Average: 1179.1986 StdDev: 1541.49 Min: 85 Median: 637.3598 Max: 73020 Percentiles: P50: 637.33 P75: 1463.16 P99: 6479.95 P99.9: 9863.86 P99.99: 30700.82 ------------------------------------------------------ ( 76, 110 ] 293 0.900% 0.900% ( 110, 170 ] 2916 8.961% 9.862% ## ( 170, 250 ] 4104 12.612% 22.474% ### ( 250, 380 ] 3806 11.696% 34.170% ## ( 380, 580 ] 4274 13.135% 47.305% ### ( 580, 870 ] 4439 13.642% 60.947% ### ( 870, 1300 ] 3808 11.703% 72.649% ## ( 1300, 1900 ] 2816 8.654% 81.303% ## ( 1900, 2900 ] 2398 7.369% 88.672% # ( 2900, 4400 ] 2263 6.955% 95.627% # ( 4400, 6600 ] 1162 3.571% 99.198% # ( 6600, 9900 ] 232 0.713% 99.911% ( 9900, 14000 ] 15 0.046% 99.957% ( 14000, 22000 ] 7 0.022% 99.978% ( 22000, 33000 ] 6 0.018% 99.997% ( 50000, 75000 ] 2 0.006% 100.003% ** DB Stats ** Uptime(secs): 13.4 total, 5.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 146.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.608 H:M:S, 41.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 167.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.065 H:M:S, 35.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/04-22:04:39 ... thread 0: (1000000,3000000) ops and (288448.8,179071.2) ops/second in (3.466820,16.753109) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 2.77 GB 125.9 2.0 0.0 2.0 4.8 2.8 0.0 1.7 79.9 188.8 26.01 16.24 45 0.578 2110K 2392 0.0 0.0 L1 6/6 560.73 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.0 1.6 84.3 84.0 9.49 3.87 1 9.493 812K 2300 0.0 0.0 L2 1/0 47.43 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 937.99 MB 0.9 3.1 2.1 1.0 3.1 2.1 0.3 1.5 96.9 95.9 33.14 15.07 12 2.762 1390K 0 0.0 0.0 L4 168/0 9.74 GB 1.0 7.4 4.5 2.9 7.3 4.5 0.2 1.6 118.2 117.0 64.19 35.71 46 1.396 3510K 5105 0.0 0.0 L5 1132/0 93.01 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1337/16 107.03 GB 0.0 13.4 7.2 6.2 16.0 9.8 5.3 5.8 103.0 123.4 132.84 70.89 104 1.277 7824K 9797 0.0 0.0 Int 0/0 0.00 KB 0.0 13.4 7.2 6.2 16.0 9.8 5.3 5.8 103.0 123.4 132.84 70.89 104 1.277 7824K 9797 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.4 7.2 6.2 13.2 7.1 0.0 0.0 116.7 115.7 117.20 62.88 66 1.776 7824K 9797 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 181.2 15.65 8.02 38 0.412 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.9 total, 16.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.01 GB write, 969.69 MB/s write, 13.36 GB read, 808.98 MB/s read, 132.8 seconds Interval compaction: 16.01 GB write, 978.71 MB/s write, 13.36 GB read, 816.50 MB/s read, 132.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 39, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 898680 Average: 13.0301 StdDev: 165.43 Min: 1 Median: 1.6970 Max: 62219 Percentiles: P50: 1.70 P75: 2.47 P99: 201.92 P99.9: 1891.29 P99.99: 3550.64 ------------------------------------------------------ [ 0, 1 ] 92990 10.347% 10.347% ## ( 1, 2 ] 511240 56.888% 67.235% ########### ( 2, 3 ] 147142 16.373% 83.608% ### ( 3, 4 ] 54454 6.059% 89.668% # ( 4, 6 ] 60133 6.691% 96.359% # ( 6, 10 ] 13211 1.470% 97.829% ( 10, 15 ] 3582 0.399% 98.228% ( 15, 22 ] 398 0.044% 98.272% ( 22, 34 ] 34 0.004% 98.276% ( 34, 51 ] 14 0.002% 98.277% ( 51, 76 ] 14 0.002% 98.279% ( 76, 110 ] 435 0.048% 98.327% ( 110, 170 ] 4464 0.497% 98.824% ( 170, 250 ] 3966 0.441% 99.265% ( 250, 380 ] 1695 0.189% 99.454% ( 380, 580 ] 1461 0.163% 99.616% ( 580, 870 ] 1072 0.119% 99.736% ( 870, 1300 ] 819 0.091% 99.827% ( 1300, 1900 ] 667 0.074% 99.901% ( 1900, 2900 ] 597 0.066% 99.968% ( 2900, 4400 ] 466 0.052% 100.019% ( 4400, 6600 ] 149 0.017% 100.036% ( 6600, 9900 ] 16 0.002% 100.038% ( 9900, 14000 ] 3 0.000% 100.038% ( 22000, 33000 ] 1 0.000% 100.038% ( 33000, 50000 ] 1 0.000% 100.038% ( 50000, 75000 ] 1 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 87441 Average: 20.0862 StdDev: 248.58 Min: 1 Median: 2.2174 Max: 30371 Percentiles: P50: 2.22 P75: 3.43 P99: 320.58 P99.9: 3320.70 P99.99: 8088.89 ------------------------------------------------------ [ 0, 1 ] 1349 1.543% 1.543% ( 1, 2 ] 37395 42.766% 44.309% ######### ( 2, 3 ] 22896 26.185% 70.493% ##### ( 3, 4 ] 9083 10.388% 80.881% ## ( 4, 6 ] 11143 12.743% 93.624% ### ( 6, 10 ] 2801 3.203% 96.828% # ( 10, 15 ] 786 0.899% 97.726% ( 15, 22 ] 101 0.116% 97.842% ( 22, 34 ] 17 0.019% 97.861% ( 34, 51 ] 6 0.007% 97.868% ( 51, 76 ] 7 0.008% 97.876% ( 76, 110 ] 59 0.067% 97.944% ( 110, 170 ] 437 0.500% 98.444% ( 170, 250 ] 378 0.432% 98.876% ( 250, 380 ] 200 0.229% 99.105% ( 380, 580 ] 185 0.212% 99.316% ( 580, 870 ] 154 0.176% 99.492% ( 870, 1300 ] 127 0.145% 99.637% ( 1300, 1900 ] 103 0.118% 99.755% ( 1900, 2900 ] 103 0.118% 99.873% ( 2900, 4400 ] 84 0.096% 99.969% ( 4400, 6600 ] 16 0.018% 99.987% ( 6600, 9900 ] 5 0.006% 99.993% ( 9900, 14000 ] 1 0.001% 99.994% ( 14000, 22000 ] 4 0.005% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 391962 Average: 17.6339 StdDev: 212.74 Min: 1 Median: 1.9662 Max: 10763 Percentiles: P50: 1.97 P75: 3.10 P99: 13.57 P99.9: 2688.65 P99.99: 3700.48 ------------------------------------------------------ [ 0, 1 ] 12717 3.244% 3.244% # ( 1, 2 ] 189676 48.391% 51.636% ########## ( 2, 3 ] 87989 22.448% 74.084% #### ( 3, 4 ] 37772 9.637% 83.721% ## ( 4, 6 ] 46006 11.737% 95.458% ## ( 6, 10 ] 11473 2.927% 98.385% # ( 10, 15 ] 3378 0.862% 99.247% ( 15, 22 ] 500 0.128% 99.375% ( 22, 34 ] 48 0.012% 99.387% ( 34, 51 ] 20 0.005% 99.392% ( 51, 76 ] 16 0.004% 99.396% ( 76, 110 ] 9 0.002% 99.398% ( 110, 170 ] 8 0.002% 99.400% ( 170, 250 ] 19 0.005% 99.405% ( 250, 380 ] 74 0.019% 99.424% ( 380, 580 ] 133 0.034% 99.458% ( 580, 870 ] 288 0.073% 99.532% ( 870, 1300 ] 433 0.110% 99.642% ( 1300, 1900 ] 541 0.138% 99.780% ( 1900, 2900 ] 596 0.152% 99.932% ( 2900, 4400 ] 425 0.108% 100.041% ( 4400, 6600 ] 179 0.046% 100.086% ( 6600, 9900 ] 32 0.008% 100.094% ( 9900, 14000 ] 5 0.001% 100.096% ** Level 3 read latency histogram (micros): Count: 1167296 Average: 13.5431 StdDev: 191.89 Min: 1 Median: 1.9973 Max: 46989 Percentiles: P50: 2.00 P75: 3.04 P99: 11.75 P99.9: 1421.59 P99.99: 1898.76 ------------------------------------------------------ [ 0, 1 ] 22718 1.946% 1.946% ( 1, 2 ] 562445 48.184% 50.130% ########## ( 2, 3 ] 285919 24.494% 74.624% ##### ( 3, 4 ] 113347 9.710% 84.334% ## ( 4, 6 ] 137662 11.793% 96.127% ## ( 6, 10 ] 30496 2.613% 98.740% # ( 10, 15 ] 8684 0.744% 99.484% ( 15, 22 ] 954 0.082% 99.566% ( 22, 34 ] 74 0.006% 99.572% ( 34, 51 ] 51 0.004% 99.576% ( 51, 76 ] 88 0.008% 99.584% ( 76, 110 ] 45 0.004% 99.588% ( 110, 170 ] 261 0.022% 99.610% ( 170, 250 ] 247 0.021% 99.631% ( 250, 380 ] 281 0.024% 99.655% ( 380, 580 ] 523 0.045% 99.700% ( 580, 870 ] 865 0.074% 99.774% ( 870, 1300 ] 1201 0.103% 99.877% ( 1300, 1900 ] 1321 0.113% 99.990% ( 1900, 2900 ] 1170 0.100% 100.090% ( 2900, 4400 ] 887 0.076% 100.166% ( 4400, 6600 ] 254 0.022% 100.188% ( 6600, 9900 ] 36 0.003% 100.191% ( 9900, 14000 ] 9 0.001% 100.192% ( 14000, 22000 ] 6 0.001% 100.193% ( 22000, 33000 ] 5 0.000% 100.193% ( 33000, 50000 ] 3 0.000% 100.193% ** Level 4 read latency histogram (micros): Count: 759108 Average: 23.3739 StdDev: 259.07 Min: 0 Median: 1.9361 Max: 81031 Percentiles: P50: 1.94 P75: 2.98 P99: 411.93 P99.9: 2536.43 P99.99: 3318.87 ------------------------------------------------------ [ 0, 1 ] 21762 2.867% 2.867% # ( 1, 2 ] 382210 50.350% 53.217% ########## ( 2, 3 ] 169107 22.277% 75.494% #### ( 3, 4 ] 67488 8.890% 84.384% ## ( 4, 6 ] 78109 10.290% 94.674% ## ( 6, 10 ] 19405 2.556% 97.230% # ( 10, 15 ] 4938 0.651% 97.881% ( 15, 22 ] 515 0.068% 97.948% ( 22, 34 ] 34 0.004% 97.953% ( 34, 51 ] 37 0.005% 97.958% ( 51, 76 ] 77 0.010% 97.968% ( 76, 110 ] 321 0.042% 98.010% ( 110, 170 ] 2827 0.372% 98.383% ( 170, 250 ] 2794 0.368% 98.751% ( 250, 380 ] 1629 0.215% 98.965% ( 380, 580 ] 1653 0.218% 99.183% ( 580, 870 ] 1734 0.228% 99.411% ( 870, 1300 ] 1575 0.207% 99.619% ( 1300, 1900 ] 1374 0.181% 99.800% ( 1900, 2900 ] 1194 0.157% 99.957% ( 2900, 4400 ] 892 0.118% 100.075% ( 4400, 6600 ] 274 0.036% 100.111% ( 6600, 9900 ] 43 0.006% 100.116% ( 9900, 14000 ] 7 0.001% 100.117% ( 14000, 22000 ] 7 0.001% 100.118% ( 22000, 33000 ] 3 0.000% 100.119% ( 33000, 50000 ] 4 0.001% 100.119% ( 75000, 110000 ] 1 0.000% 100.119% ** Level 5 read latency histogram (micros): Count: 70229 Average: 674.0321 StdDev: 1155.59 Min: 81 Median: 251.4866 Max: 73020 Percentiles: P50: 251.49 P75: 641.56 P99: 5766.40 P99.9: 9327.78 P99.99: 23791.35 ------------------------------------------------------ ( 76, 110 ] 1876 2.671% 2.671% # ( 110, 170 ] 17489 24.903% 27.574% ##### ( 170, 250 ] 15652 22.287% 49.861% #### ( 250, 380 ] 8526 12.140% 62.001% ## ( 380, 580 ] 7905 11.256% 73.257% ## ( 580, 870 ] 5765 8.209% 81.466% ## ( 870, 1300 ] 4076 5.804% 87.270% # ( 1300, 1900 ] 2835 4.037% 91.307% # ( 1900, 2900 ] 2416 3.440% 94.747% # ( 2900, 4400 ] 2265 3.225% 97.972% # ( 4400, 6600 ] 1162 1.655% 99.627% ( 6600, 9900 ] 232 0.330% 99.957% ( 9900, 14000 ] 15 0.021% 99.979% ( 14000, 22000 ] 7 0.010% 99.989% ( 22000, 33000 ] 6 0.009% 99.997% ( 50000, 75000 ] 2 0.003% 100.000% ** DB Stats ** Uptime(secs): 16.9 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 174.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.608 H:M:S, 33.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/04-22:04:44 ... thread 0: (1000000,4000000) ops and (200062.6,183895.0) ops/second in (4.998436,21.751545) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/6 3.75 GB 251.8 3.3 0.0 3.3 7.0 3.7 0.0 1.9 98.2 211.2 33.99 23.65 66 0.515 3390K 3659 0.0 0.0 L1 6/6 560.73 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.0 1.6 84.3 84.0 9.49 3.87 1 9.493 812K 2300 0.0 0.0 L2 1/0 47.43 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 13/0 937.99 MB 0.9 3.1 2.1 1.0 3.1 2.1 0.3 1.5 96.9 95.9 33.14 15.07 12 2.762 1390K 0 0.0 0.0 L4 168/0 9.74 GB 1.0 7.4 4.5 2.9 7.3 4.5 0.2 1.6 118.2 117.0 64.19 35.71 46 1.396 3510K 5105 0.0 0.0 L5 1132/0 93.01 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1338/12 108.02 GB 0.0 14.6 7.2 7.4 18.2 10.8 5.3 4.9 106.1 132.5 140.82 78.30 125 1.127 9103K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 7.2 7.4 18.2 10.8 5.3 4.9 106.1 132.5 140.82 78.30 125 1.127 9103K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 7.2 7.4 14.5 7.0 0.0 0.0 122.5 121.5 121.99 67.58 71 1.718 9103K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 204.1 18.83 10.73 54 0.349 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.9 total, 21.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.23 GB write, 851.92 MB/s write, 14.59 GB read, 681.93 MB/s read, 140.8 seconds Interval compaction: 18.23 GB write, 858.02 MB/s write, 14.59 GB read, 686.81 MB/s read, 140.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 39, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1218011 Average: 14.6418 StdDev: 146.85 Min: 0 Median: 1.6392 Max: 62219 Percentiles: P50: 1.64 P75: 2.34 P99: 240.76 P99.9: 1466.36 P99.99: 2879.32 ------------------------------------------------------ [ 0, 1 ] 171557 14.085% 14.085% ### ( 1, 2 ] 684373 56.188% 70.273% ########### ( 2, 3 ] 169548 13.920% 84.193% ### ( 3, 4 ] 63598 5.221% 89.414% # ( 4, 6 ] 67512 5.543% 94.957% # ( 6, 10 ] 14633 1.201% 96.158% ( 10, 15 ] 4020 0.330% 96.489% ( 15, 22 ] 477 0.039% 96.528% ( 22, 34 ] 45 0.004% 96.531% ( 34, 51 ] 23 0.002% 96.533% ( 51, 76 ] 16 0.001% 96.535% ( 76, 110 ] 1649 0.135% 96.670% ( 110, 170 ] 17081 1.402% 98.072% ( 170, 250 ] 12774 1.049% 99.121% ( 250, 380 ] 3918 0.322% 99.443% ( 380, 580 ] 2980 0.245% 99.687% ( 580, 870 ] 1537 0.126% 99.814% ( 870, 1300 ] 864 0.071% 99.885% ( 1300, 1900 ] 678 0.056% 99.940% ( 1900, 2900 ] 619 0.051% 99.991% ( 2900, 4400 ] 485 0.040% 100.031% ( 4400, 6600 ] 149 0.012% 100.043% ( 6600, 9900 ] 16 0.001% 100.044% ( 9900, 14000 ] 3 0.000% 100.045% ( 22000, 33000 ] 1 0.000% 100.045% ( 33000, 50000 ] 1 0.000% 100.045% ( 50000, 75000 ] 1 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 98698 Average: 21.2070 StdDev: 235.69 Min: 1 Median: 2.3153 Max: 30371 Percentiles: P50: 2.32 P75: 3.67 P99: 343.85 P99.9: 3119.68 P99.99: 7345.93 ------------------------------------------------------ [ 0, 1 ] 1507 1.527% 1.527% ( 1, 2 ] 39855 40.381% 41.908% ######## ( 2, 3 ] 25329 25.663% 67.571% ##### ( 3, 4 ] 11007 11.152% 78.723% ## ( 4, 6 ] 13207 13.381% 92.104% ### ( 6, 10 ] 3319 3.363% 95.467% # ( 10, 15 ] 918 0.930% 96.397% ( 15, 22 ] 171 0.173% 96.570% ( 22, 34 ] 37 0.037% 96.608% ( 34, 51 ] 9 0.009% 96.617% ( 51, 76 ] 7 0.007% 96.624% ( 76, 110 ] 122 0.124% 96.748% ( 110, 170 ] 1177 1.193% 97.940% ( 170, 250 ] 815 0.826% 98.766% ( 250, 380 ] 320 0.324% 99.090% ( 380, 580 ] 273 0.277% 99.367% ( 580, 870 ] 175 0.177% 99.544% ( 870, 1300 ] 131 0.133% 99.677% ( 1300, 1900 ] 104 0.105% 99.782% ( 1900, 2900 ] 104 0.105% 99.888% ( 2900, 4400 ] 84 0.085% 99.973% ( 4400, 6600 ] 16 0.016% 99.989% ( 6600, 9900 ] 5 0.005% 99.994% ( 9900, 14000 ] 1 0.001% 99.995% ( 14000, 22000 ] 4 0.004% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 391962 Average: 17.6339 StdDev: 212.74 Min: 1 Median: 1.9662 Max: 10763 Percentiles: P50: 1.97 P75: 3.10 P99: 13.57 P99.9: 2688.65 P99.99: 3700.48 ------------------------------------------------------ [ 0, 1 ] 12717 3.244% 3.244% # ( 1, 2 ] 189676 48.391% 51.636% ########## ( 2, 3 ] 87989 22.448% 74.084% #### ( 3, 4 ] 37772 9.637% 83.721% ## ( 4, 6 ] 46006 11.737% 95.458% ## ( 6, 10 ] 11473 2.927% 98.385% # ( 10, 15 ] 3378 0.862% 99.247% ( 15, 22 ] 500 0.128% 99.375% ( 22, 34 ] 48 0.012% 99.387% ( 34, 51 ] 20 0.005% 99.392% ( 51, 76 ] 16 0.004% 99.396% ( 76, 110 ] 9 0.002% 99.398% ( 110, 170 ] 8 0.002% 99.400% ( 170, 250 ] 19 0.005% 99.405% ( 250, 380 ] 74 0.019% 99.424% ( 380, 580 ] 133 0.034% 99.458% ( 580, 870 ] 288 0.073% 99.532% ( 870, 1300 ] 433 0.110% 99.642% ( 1300, 1900 ] 541 0.138% 99.780% ( 1900, 2900 ] 596 0.152% 99.932% ( 2900, 4400 ] 425 0.108% 100.041% ( 4400, 6600 ] 179 0.046% 100.086% ( 6600, 9900 ] 32 0.008% 100.094% ( 9900, 14000 ] 5 0.001% 100.096% ** Level 3 read latency histogram (micros): Count: 1168091 Average: 13.6690 StdDev: 191.90 Min: 1 Median: 1.9980 Max: 46989 Percentiles: P50: 2.00 P75: 3.04 P99: 12.20 P99.9: 1421.23 P99.99: 1898.72 ------------------------------------------------------ [ 0, 1 ] 22718 1.945% 1.945% ( 1, 2 ] 562445 48.151% 50.096% ########## ( 2, 3 ] 285919 24.477% 74.573% ##### ( 3, 4 ] 113347 9.704% 84.277% ## ( 4, 6 ] 137662 11.785% 96.062% ## ( 6, 10 ] 30496 2.611% 98.673% # ( 10, 15 ] 8684 0.743% 99.416% ( 15, 22 ] 954 0.082% 99.498% ( 22, 34 ] 74 0.006% 99.504% ( 34, 51 ] 51 0.004% 99.509% ( 51, 76 ] 88 0.008% 99.516% ( 76, 110 ] 79 0.007% 99.523% ( 110, 170 ] 636 0.054% 99.577% ( 170, 250 ] 505 0.043% 99.620% ( 250, 380 ] 355 0.030% 99.651% ( 380, 580 ] 568 0.049% 99.700% ( 580, 870 ] 874 0.075% 99.774% ( 870, 1300 ] 1201 0.103% 99.877% ( 1300, 1900 ] 1321 0.113% 99.990% ( 1900, 2900 ] 1170 0.100% 100.090% ( 2900, 4400 ] 887 0.076% 100.166% ( 4400, 6600 ] 254 0.022% 100.188% ( 6600, 9900 ] 36 0.003% 100.191% ( 9900, 14000 ] 9 0.001% 100.192% ( 14000, 22000 ] 6 0.001% 100.192% ( 22000, 33000 ] 5 0.000% 100.193% ( 33000, 50000 ] 3 0.000% 100.193% ** Level 4 read latency histogram (micros): Count: 769890 Average: 25.7804 StdDev: 258.54 Min: 0 Median: 1.9502 Max: 81031 Percentiles: P50: 1.95 P75: 3.06 P99: 464.05 P99.9: 2531.63 P99.99: 3318.27 ------------------------------------------------------ [ 0, 1 ] 21762 2.827% 2.827% # ( 1, 2 ] 382218 49.646% 52.472% ########## ( 2, 3 ] 169194 21.976% 74.449% #### ( 3, 4 ] 67554 8.775% 83.223% ## ( 4, 6 ] 78237 10.162% 93.385% ## ( 6, 10 ] 19414 2.522% 95.907% # ( 10, 15 ] 4940 0.642% 96.549% ( 15, 22 ] 515 0.067% 96.616% ( 22, 34 ] 34 0.004% 96.620% ( 34, 51 ] 38 0.005% 96.625% ( 51, 76 ] 77 0.010% 96.635% ( 76, 110 ] 788 0.102% 96.737% ( 110, 170 ] 7931 1.030% 97.767% ( 170, 250 ] 6151 0.799% 98.566% ( 250, 380 ] 2406 0.313% 98.879% ( 380, 580 ] 2218 0.288% 99.167% ( 580, 870 ] 1910 0.248% 99.415% ( 870, 1300 ] 1596 0.207% 99.622% ( 1300, 1900 ] 1376 0.179% 99.801% ( 1900, 2900 ] 1205 0.157% 99.958% ( 2900, 4400 ] 893 0.116% 100.074% ( 4400, 6600 ] 274 0.036% 100.109% ( 6600, 9900 ] 43 0.006% 100.115% ( 9900, 14000 ] 7 0.001% 100.116% ( 14000, 22000 ] 7 0.001% 100.117% ( 22000, 33000 ] 3 0.000% 100.117% ( 33000, 50000 ] 4 0.001% 100.118% ( 75000, 110000 ] 1 0.000% 100.118% ** Level 5 read latency histogram (micros): Count: 131580 Average: 452.5738 StdDev: 881.16 Min: 81 Median: 201.0196 Max: 73020 Percentiles: P50: 201.02 P75: 361.37 P99: 4606.75 P99.9: 8461.31 P99.99: 16105.14 ------------------------------------------------------ ( 76, 110 ] 4686 3.561% 3.561% # ( 110, 170 ] 47513 36.110% 39.671% ####### ( 170, 250 ] 35054 26.641% 66.312% ##### ( 250, 380 ] 13345 10.142% 76.454% ## ( 380, 580 ] 11127 8.456% 84.910% ## ( 580, 870 ] 6662 5.063% 89.973% # ( 870, 1300 ] 4206 3.197% 93.170% # ( 1300, 1900 ] 2854 2.169% 95.339% ( 1900, 2900 ] 2438 1.853% 97.192% ( 2900, 4400 ] 2271 1.726% 98.918% ( 4400, 6600 ] 1162 0.883% 99.801% ( 6600, 9900 ] 233 0.177% 99.978% ( 9900, 14000 ] 15 0.011% 99.989% ( 14000, 22000 ] 7 0.005% 99.995% ( 22000, 33000 ] 6 0.005% 99.999% ( 50000, 75000 ] 2 0.002% 100.001% ** DB Stats ** Uptime(secs): 21.9 total, 5.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 179.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.048 H:M:S, 32.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 196.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.440 H:M:S, 28.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 276.006 micros/op 14476 ops/sec 60.166 seconds 870996 operations; 14.0 MB/s (219999 of 219999 found) Microseconds per read: Count: 870996 Average: 276.0083 StdDev: 880.21 Min: 2 Median: 202.6374 Max: 103579 Percentiles: P50: 202.64 P75: 244.79 P99: 1253.28 P99.9: 16410.68 P99.99: 32208.67 ------------------------------------------------------ ( 1, 2 ] 3 0.000% 0.000% ( 2, 3 ] 26 0.003% 0.003% ( 3, 4 ] 44 0.005% 0.008% ( 4, 6 ] 70 0.008% 0.016% ( 6, 10 ] 241 0.028% 0.044% ( 10, 15 ] 1891 0.217% 0.261% ( 15, 22 ] 2162 0.248% 0.509% ( 22, 34 ] 6542 0.751% 1.261% ( 34, 51 ] 1986 0.228% 1.489% ( 51, 76 ] 262 0.030% 1.519% ( 76, 110 ] 2453 0.282% 1.800% ( 110, 170 ] 251222 28.843% 30.643% ###### ( 170, 250 ] 413259 47.447% 78.090% ######### ( 250, 380 ] 107552 12.348% 90.438% ## ( 380, 580 ] 52063 5.977% 96.416% # ( 580, 870 ] 17038 1.956% 98.372% ( 870, 1300 ] 6139 0.705% 99.077% ( 1300, 1900 ] 2776 0.319% 99.395% ( 1900, 2900 ] 1930 0.222% 99.617% ( 2900, 4400 ] 1487 0.171% 99.788% ( 4400, 6600 ] 471 0.054% 99.842% ( 6600, 9900 ] 108 0.012% 99.854% ( 9900, 14000 ] 196 0.023% 99.877% ( 14000, 22000 ] 677 0.078% 99.954% ( 22000, 33000 ] 335 0.038% 99.993% ( 33000, 50000 ] 46 0.005% 99.998% ( 50000, 75000 ] 14 0.002% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14357613 rocksdb.bloom.filter.full.positive COUNT : 1011028 rocksdb.bloom.filter.full.true.positive COUNT : 870633 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 363 rocksdb.memtable.miss COUNT : 870633 rocksdb.l0.hit COUNT : 33792 rocksdb.l1.hit COUNT : 7677 rocksdb.l2andup.hit COUNT : 829164 rocksdb.compaction.key.drop.new COUNT : 152258 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4817862 rocksdb.number.keys.read COUNT : 870996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4972033584 rocksdb.bytes.read COUNT : 870996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1594 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 41873832 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 20453217856 rocksdb.compact.write.bytes COUNT : 20285272764 rocksdb.flush.write.bytes COUNT : 4954401032 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 31 rocksdb.number.superversion_acquires COUNT : 946 rocksdb.number.superversion_releases COUNT : 915 rocksdb.number.superversion_cleanups COUNT : 236 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 255 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4914361344 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1824768 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 23550449060 rocksdb.non.last.level.read.count COUNT : 5545797 rocksdb.block.checksum.compute.count COUNT : 5972874 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 201.570901 P95 : 531.594817 P99 : 1252.802548 P100 : 103579.000000 COUNT : 870996 SUM : 239491113 rocksdb.db.write.micros P50 : 1.540224 P95 : 4.418330 P99 : 9.416282 P100 : 958651.000000 COUNT : 4817862 SUM : 53903618 rocksdb.compaction.times.micros P50 : 1190000.000000 P95 : 4520000.000000 P99 : 36840000.000000 P100 : 37318866.000000 COUNT : 76 SUM : 168116292 rocksdb.compaction.times.cpu_micros P50 : 846190.476190 P95 : 2500000.000000 P99 : 14834777.000000 P100 : 14834777.000000 COUNT : 76 SUM : 91036143 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 825.384615 P95 : 31900.000000 P99 : 110872.000000 P100 : 110872.000000 COUNT : 68 SUM : 420462 rocksdb.compaction.outfile.sync.micros P50 : 14000.000000 P95 : 203333.333333 P99 : 373500.000000 P100 : 513879.000000 COUNT : 230 SUM : 10578365 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 305.714286 P95 : 3980.000000 P99 : 5078.000000 P100 : 5078.000000 COUNT : 164 SUM : 176084 rocksdb.table.open.io.micros P50 : 11930.097087 P95 : 21496.721311 P99 : 29576.250000 P100 : 41461.000000 COUNT : 1594 SUM : 18378848 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.928743 P95 : 13.829667 P99 : 227.798951 P100 : 46992.000000 COUNT : 4950601 SUM : 94428657 rocksdb.read.block.get.micros P50 : 155.664625 P95 : 376.086005 P99 : 1260.684350 P100 : 81034.000000 COUNT : 1020677 SUM : 204304302 rocksdb.write.raw.block.micros P50 : 0.538985 P95 : 1.441483 P99 : 3.628083 P100 : 91604.000000 COUNT : 6113096 SUM : 19927529 rocksdb.numfiles.in.singlecompaction P50 : 2.840000 P95 : 6.266667 P99 : 22.480000 P100 : 25.000000 COUNT : 96 SUM : 347 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566586 P95 : 1295.362474 P99 : 2698.126787 P100 : 958487.000000 COUNT : 206260 SUM : 41888372 rocksdb.sst.read.micros P50 : 2.149922 P95 : 207.693041 P99 : 504.469599 P100 : 81031.000000 COUNT : 5545843 SUM : 279687194 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 870996 SUM : 870996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4817862 SUM : 4972033584 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 223333.333333 P95 : 968800.000000 P99 : 1153760.000000 P100 : 1192512.000000 COUNT : 68 SUM : 21754249 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 255 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0