[2024-11-19 13:01:37.651880] Starting SPDK v25.01-pre git sha1 dcc2ca8f3 / DPDK 24.03.0 initialization... [2024-11-19 13:01:37.652147] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3719585 ] Set seed to 1732017697644960 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 13:01:37.779443] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 13:01:37.887636] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 13:01:37.887681] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3719585' to capture a snapshot of events at runtime. [2024-11-19 13:01:37.887692] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 13:01:37.887702] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 13:01:37.887710] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3719585 for offline analysis/debug. [2024-11-19 13:01:37.889120] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 13:01:43 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-13:01:50 ... thread 0: (1000000,1000000) ops and (140538.8,140538.8) ops/second in (7.115475,7.115475) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.10 GB 56.3 0.4 0.0 0.4 1.2 0.9 0.0 1.4 40.8 135.8 9.23 4.07 11 0.839 382K 2663 0.0 0.0 L1 1/1 45.68 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 54.44 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 37/8 2.04 GB 1.6 2.0 1.8 0.2 2.0 1.8 0.1 1.1 101.6 99.6 20.56 9.94 7 2.938 1478K 0 0.0 0.0 L4 167/23 11.94 GB 1.0 3.3 1.8 1.5 3.1 1.6 0.1 1.7 120.6 112.3 28.28 15.32 15 1.886 641K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 329/40 24.34 GB 0.0 5.7 3.7 2.1 6.3 4.2 0.1 7.4 101.2 111.5 58.08 29.34 33 1.760 2502K 2663 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 3.7 2.1 6.3 4.2 0.1 7.4 101.2 111.5 58.08 29.34 33 1.760 2502K 2663 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 3.7 2.1 5.5 3.4 0.0 0.0 114.1 108.6 51.53 26.81 23 2.240 2502K 2663 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 134.2 6.55 2.52 10 0.655 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.2 total, 7.1 interval Flush(GB): cumulative 0.859, interval 0.859 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.33 GB write, 895.39 MB/s write, 5.74 GB read, 812.42 MB/s read, 58.1 seconds Interval compaction: 6.33 GB write, 909.93 MB/s write, 5.74 GB read, 825.62 MB/s read, 58.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 22, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 178009 Average: 55.9668 StdDev: 362.65 Min: 1 Median: 1.9837 Max: 37985 Percentiles: P50: 1.98 P75: 3.04 P99: 1662.31 P99.9: 4264.08 P99.99: 6468.75 ------------------------------------------------------ [ 0, 1 ] 5405 3.036% 3.036% # ( 1, 2 ] 84984 47.741% 50.778% ########## ( 2, 3 ] 42433 23.838% 74.615% ##### ( 3, 4 ] 15890 8.927% 83.542% ## ( 4, 6 ] 16992 9.546% 93.087% ## ( 6, 10 ] 4458 2.504% 95.592% # ( 10, 15 ] 780 0.438% 96.030% ( 15, 22 ] 88 0.049% 96.079% ( 22, 34 ] 5 0.003% 96.082% ( 34, 51 ] 5 0.003% 96.085% ( 51, 76 ] 5 0.003% 96.088% ( 76, 110 ] 3 0.002% 96.090% ( 110, 170 ] 44 0.025% 96.114% ( 170, 250 ] 134 0.075% 96.190% ( 250, 380 ] 389 0.219% 96.408% ( 380, 580 ] 847 0.476% 96.884% ( 580, 870 ] 1494 0.839% 97.723% ( 870, 1300 ] 1661 0.933% 98.656% ( 1300, 1900 ] 1015 0.570% 99.226% ( 1900, 2900 ] 668 0.375% 99.602% ( 2900, 4400 ] 585 0.329% 99.930% ( 4400, 6600 ] 114 0.064% 99.994% ( 6600, 9900 ] 12 0.007% 100.001% ( 9900, 14000 ] 1 0.001% 100.002% ( 14000, 22000 ] 7 0.004% 100.006% ( 33000, 50000 ] 1 0.001% 100.006% ** Level 1 read latency histogram (micros): Count: 41 Average: 1397.4634 StdDev: 1115.45 Min: 210 Median: 1058.1250 Max: 3997 Percentiles: P50: 1058.12 P75: 1875.00 P99: 3997.00 P99.9: 3997.00 P99.99: 3997.00 ------------------------------------------------------ ( 170, 250 ] 3 7.317% 7.317% # ( 250, 380 ] 4 9.756% 17.073% ## ( 380, 580 ] 4 9.756% 26.829% ## ( 580, 870 ] 6 14.634% 41.463% ### ( 870, 1300 ] 8 19.512% 60.976% #### ( 1300, 1900 ] 6 14.634% 75.610% ### ( 1900, 2900 ] 3 7.317% 82.927% # ( 2900, 4400 ] 7 17.073% 100.000% ### ** Level 2 read latency histogram (micros): Count: 410129 Average: 16.0012 StdDev: 186.48 Min: 1 Median: 2.0577 Max: 14959 Percentiles: P50: 2.06 P75: 2.99 P99: 12.84 P99.9: 1255.90 P99.99: 1672.57 ------------------------------------------------------ [ 0, 1 ] 7547 1.840% 1.840% ( 1, 2 ] 191161 46.610% 48.450% ######### ( 2, 3 ] 110218 26.874% 75.324% ##### ( 3, 4 ] 40868 9.965% 85.289% ## ( 4, 6 ] 43122 10.514% 95.803% ## ( 6, 10 ] 11584 2.824% 98.628% # ( 10, 15 ] 2685 0.655% 99.282% ( 15, 22 ] 453 0.110% 99.393% ( 22, 34 ] 54 0.013% 99.406% ( 34, 51 ] 40 0.010% 99.416% ( 51, 76 ] 27 0.007% 99.422% ( 76, 110 ] 15 0.004% 99.426% ( 110, 170 ] 47 0.011% 99.437% ( 170, 250 ] 98 0.024% 99.461% ( 250, 380 ] 222 0.054% 99.515% ( 380, 580 ] 423 0.103% 99.618% ( 580, 870 ] 620 0.151% 99.770% ( 870, 1300 ] 596 0.145% 99.915% ( 1300, 1900 ] 496 0.121% 100.036% ( 1900, 2900 ] 418 0.102% 100.138% ( 2900, 4400 ] 407 0.099% 100.237% ( 4400, 6600 ] 117 0.029% 100.266% ( 6600, 9900 ] 14 0.003% 100.269% ( 9900, 14000 ] 3 0.001% 100.270% ( 14000, 22000 ] 1 0.000% 100.270% ** Level 3 read latency histogram (micros): Count: 568859 Average: 17.2587 StdDev: 210.82 Min: 1 Median: 2.1905 Max: 43801 Percentiles: P50: 2.19 P75: 3.12 P99: 14.06 P99.9: 1800.25 P99.99: 2544.23 ------------------------------------------------------ [ 0, 1 ] 6530 1.148% 1.148% ( 1, 2 ] 246106 43.263% 44.411% ######### ( 2, 3 ] 166877 29.335% 73.746% ###### ( 3, 4 ] 59380 10.438% 84.185% ## ( 4, 6 ] 65260 11.472% 95.657% ## ( 6, 10 ] 16360 2.876% 98.533% # ( 10, 15 ] 3274 0.576% 99.108% ( 15, 22 ] 421 0.074% 99.182% ( 22, 34 ] 33 0.006% 99.188% ( 34, 51 ] 54 0.009% 99.198% ( 51, 76 ] 45 0.008% 99.206% ( 76, 110 ] 29 0.005% 99.211% ( 110, 170 ] 38 0.007% 99.217% ( 170, 250 ] 105 0.018% 99.236% ( 250, 380 ] 293 0.052% 99.287% ( 380, 580 ] 634 0.111% 99.399% ( 580, 870 ] 1074 0.189% 99.588% ( 870, 1300 ] 1162 0.204% 99.792% ( 1300, 1900 ] 739 0.130% 99.922% ( 1900, 2900 ] 604 0.106% 100.028% ( 2900, 4400 ] 587 0.103% 100.131% ( 4400, 6600 ] 112 0.020% 100.151% ( 6600, 9900 ] 16 0.003% 100.154% ( 9900, 14000 ] 7 0.001% 100.155% ( 14000, 22000 ] 4 0.001% 100.156% ( 22000, 33000 ] 3 0.001% 100.156% ( 33000, 50000 ] 1 0.000% 100.156% ** Level 4 read latency histogram (micros): Count: 648532 Average: 31.4385 StdDev: 288.21 Min: 1 Median: 2.2153 Max: 51982 Percentiles: P50: 2.22 P75: 3.24 P99: 760.95 P99.9: 2093.46 P99.99: 2540.73 ------------------------------------------------------ [ 0, 1 ] 7933 1.223% 1.223% ( 1, 2 ] 276451 42.627% 43.850% ######### ( 2, 3 ] 185280 28.569% 72.420% ###### ( 3, 4 ] 69976 10.790% 83.209% ## ( 4, 6 ] 75817 11.691% 94.900% ## ( 6, 10 ] 18083 2.788% 97.688% # ( 10, 15 ] 3536 0.545% 98.234% ( 15, 22 ] 468 0.072% 98.306% ( 22, 34 ] 47 0.007% 98.313% ( 34, 51 ] 58 0.009% 98.322% ( 51, 76 ] 62 0.010% 98.331% ( 76, 110 ] 26 0.004% 98.335% ( 110, 170 ] 68 0.010% 98.346% ( 170, 250 ] 261 0.040% 98.386% ( 250, 380 ] 700 0.108% 98.494% ( 380, 580 ] 1602 0.247% 98.741% ( 580, 870 ] 2692 0.415% 99.156% ( 870, 1300 ] 2841 0.438% 99.594% ( 1300, 1900 ] 1731 0.267% 99.861% ( 1900, 2900 ] 1305 0.201% 100.062% ( 2900, 4400 ] 1258 0.194% 100.256% ( 4400, 6600 ] 290 0.045% 100.301% ( 6600, 9900 ] 45 0.007% 100.308% ( 9900, 14000 ] 1 0.000% 100.308% ( 14000, 22000 ] 9 0.001% 100.310% ( 22000, 33000 ] 4 0.001% 100.310% ( 33000, 50000 ] 2 0.000% 100.311% ( 50000, 75000 ] 1 0.000% 100.311% ** Level 5 read latency histogram (micros): Count: 6611 Average: 1418.7893 StdDev: 1282.94 Min: 101 Median: 1019.0491 Max: 19763 Percentiles: P50: 1019.05 P75: 1766.98 P99: 6218.15 P99.9: 12678.98 P99.99: 19763.00 ------------------------------------------------------ ( 76, 110 ] 4 0.061% 0.061% ( 110, 170 ] 35 0.529% 0.590% ( 170, 250 ] 128 1.936% 2.526% ( 250, 380 ] 371 5.612% 8.138% # ( 380, 580 ] 866 13.099% 21.237% ### ( 580, 870 ] 1393 21.071% 42.308% #### ( 870, 1300 ] 1467 22.190% 64.499% #### ( 1300, 1900 ] 892 13.493% 77.991% ### ( 1900, 2900 ] 656 9.923% 87.914% ## ( 2900, 4400 ] 580 8.773% 96.687% ## ( 4400, 6600 ] 185 2.798% 99.486% # ( 6600, 9900 ] 24 0.363% 99.849% ( 9900, 14000 ] 5 0.076% 99.924% ( 14000, 22000 ] 5 0.076% 100.000% ** DB Stats ** Uptime(secs): 7.2 total, 7.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 136.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.210 H:M:S, 44.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 138.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.210 H:M:S, 45.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/19-13:01:55 ... thread 0: (1000000,2000000) ops and (194681.9,163237.9) ops/second in (5.136585,12.252060) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 1.84 GB 99.9 1.0 0.0 1.0 2.8 1.8 0.0 1.5 53.7 153.9 18.75 9.41 27 0.694 1021K 6226 0.0 0.0 L1 4/0 294.35 MB 29.4 0.3 0.2 0.0 0.3 0.2 0.0 1.2 30.9 30.7 9.59 1.44 1 9.587 300K 1847 0.0 0.0 L2 1/0 54.44 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 978.31 MB 1.0 2.0 1.8 0.2 2.0 1.8 0.1 1.1 101.6 99.6 20.56 9.94 7 2.938 1478K 0 0.0 0.0 L4 151/0 9.59 GB 1.0 8.6 2.8 5.7 7.4 1.7 0.1 2.6 134.4 116.6 65.19 36.14 33 1.975 1660K 0 0.0 0.0 L5 148/0 11.69 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 337/12 24.41 GB 0.0 11.9 4.9 6.9 12.5 5.6 2.7 6.8 106.5 112.5 114.08 56.94 68 1.678 4461K 8073 0.0 0.0 Int 0/0 0.00 KB 0.0 11.9 4.9 6.9 12.5 5.6 2.6 6.8 106.5 112.5 114.08 56.94 68 1.678 4461K 8073 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.9 4.9 6.9 10.7 3.7 0.0 0.0 118.7 106.9 102.37 51.56 44 2.327 4461K 8073 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 161.1 11.71 5.37 24 0.488 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.3 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.53 GB write, 1037.13 MB/s write, 11.87 GB read, 982.54 MB/s read, 114.1 seconds Interval compaction: 12.53 GB write, 1046.92 MB/s write, 11.87 GB read, 991.81 MB/s read, 114.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 38, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 391255 Average: 45.8488 StdDev: 293.63 Min: 1 Median: 1.8321 Max: 37985 Percentiles: P50: 1.83 P75: 2.81 P99: 1236.96 P99.9: 3818.35 P99.99: 4907.02 ------------------------------------------------------ [ 0, 1 ] 27794 7.104% 7.104% # ( 1, 2 ] 201694 51.551% 58.654% ########## ( 2, 3 ] 78770 20.133% 78.787% #### ( 3, 4 ] 27005 6.902% 85.689% # ( 4, 6 ] 27711 7.083% 92.772% # ( 6, 10 ] 7368 1.883% 94.655% ( 10, 15 ] 1267 0.324% 94.979% ( 15, 22 ] 142 0.036% 95.015% ( 22, 34 ] 10 0.003% 95.018% ( 34, 51 ] 6 0.002% 95.019% ( 51, 76 ] 10 0.003% 95.022% ( 76, 110 ] 160 0.041% 95.063% ( 110, 170 ] 2325 0.594% 95.657% ( 170, 250 ] 2790 0.713% 96.370% ( 250, 380 ] 1972 0.504% 96.874% ( 380, 580 ] 2653 0.678% 97.552% ( 580, 870 ] 3172 0.811% 98.363% ( 870, 1300 ] 2923 0.747% 99.110% ( 1300, 1900 ] 1606 0.410% 99.520% ( 1900, 2900 ] 989 0.253% 99.773% ( 2900, 4400 ] 813 0.208% 99.981% ( 4400, 6600 ] 160 0.041% 100.022% ( 6600, 9900 ] 13 0.003% 100.025% ( 9900, 14000 ] 4 0.001% 100.026% ( 14000, 22000 ] 7 0.002% 100.028% ( 33000, 50000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 12174 Average: 34.1506 StdDev: 214.19 Min: 1 Median: 2.2763 Max: 4551 Percentiles: P50: 2.28 P75: 3.26 P99: 923.82 P99.9: 3601.86 P99.99: 4384.47 ------------------------------------------------------ [ 0, 1 ] 57 0.468% 0.468% ( 1, 2 ] 4977 40.882% 41.350% ######## ( 2, 3 ] 3811 31.304% 72.655% ###### ( 3, 4 ] 1089 8.945% 81.600% ## ( 4, 6 ] 1234 10.136% 91.736% ## ( 6, 10 ] 325 2.670% 94.406% # ( 10, 15 ] 56 0.460% 94.866% ( 15, 22 ] 5 0.041% 94.907% ( 76, 110 ] 11 0.090% 94.998% ( 110, 170 ] 122 1.002% 96.000% ( 170, 250 ] 153 1.257% 97.256% ( 250, 380 ] 59 0.485% 97.741% ( 380, 580 ] 73 0.600% 98.341% ( 580, 870 ] 73 0.600% 98.940% ( 870, 1300 ] 58 0.476% 99.417% ( 1300, 1900 ] 33 0.271% 99.688% ( 1900, 2900 ] 16 0.131% 99.819% ( 2900, 4400 ] 21 0.172% 99.992% ( 4400, 6600 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 410323 Average: 16.2879 StdDev: 187.59 Min: 1 Median: 2.0586 Max: 14959 Percentiles: P50: 2.06 P75: 2.99 P99: 13.20 P99.9: 1269.90 P99.99: 1688.83 ------------------------------------------------------ [ 0, 1 ] 7547 1.839% 1.839% ( 1, 2 ] 191161 46.588% 48.427% ######### ( 2, 3 ] 110218 26.861% 75.288% ##### ( 3, 4 ] 40868 9.960% 85.248% ## ( 4, 6 ] 43122 10.509% 95.758% ## ( 6, 10 ] 11584 2.823% 98.581% # ( 10, 15 ] 2685 0.654% 99.235% ( 15, 22 ] 453 0.110% 99.346% ( 22, 34 ] 54 0.013% 99.359% ( 34, 51 ] 40 0.010% 99.369% ( 51, 76 ] 27 0.007% 99.375% ( 76, 110 ] 16 0.004% 99.379% ( 110, 170 ] 84 0.020% 99.399% ( 170, 250 ] 139 0.034% 99.433% ( 250, 380 ] 243 0.059% 99.493% ( 380, 580 ] 451 0.110% 99.603% ( 580, 870 ] 645 0.157% 99.760% ( 870, 1300 ] 619 0.151% 99.911% ( 1300, 1900 ] 503 0.123% 100.033% ( 1900, 2900 ] 424 0.103% 100.136% ( 2900, 4400 ] 411 0.100% 100.237% ( 4400, 6600 ] 118 0.029% 100.265% ( 6600, 9900 ] 14 0.003% 100.269% ( 9900, 14000 ] 3 0.001% 100.270% ( 14000, 22000 ] 1 0.000% 100.270% ** Level 3 read latency histogram (micros): Count: 751262 Average: 17.3188 StdDev: 197.75 Min: 1 Median: 2.1835 Max: 43801 Percentiles: P50: 2.18 P75: 3.12 P99: 58.73 P99.9: 1799.85 P99.99: 2562.12 ------------------------------------------------------ [ 0, 1 ] 9434 1.256% 1.256% ( 1, 2 ] 326097 43.407% 44.662% ######### ( 2, 3 ] 218533 29.089% 73.751% ###### ( 3, 4 ] 78002 10.383% 84.134% ## ( 4, 6 ] 85016 11.316% 95.450% ## ( 6, 10 ] 21814 2.904% 98.354% # ( 10, 15 ] 4177 0.556% 98.910% ( 15, 22 ] 561 0.075% 98.985% ( 22, 34 ] 39 0.005% 98.990% ( 34, 51 ] 60 0.008% 98.998% ( 51, 76 ] 53 0.007% 99.005% ( 76, 110 ] 56 0.007% 99.012% ( 110, 170 ] 309 0.041% 99.053% ( 170, 250 ] 424 0.056% 99.110% ( 250, 380 ] 594 0.079% 99.189% ( 380, 580 ] 1079 0.144% 99.333% ( 580, 870 ] 1692 0.225% 99.558% ( 870, 1300 ] 1711 0.228% 99.786% ( 1300, 1900 ] 1032 0.137% 99.923% ( 1900, 2900 ] 761 0.101% 100.024% ( 2900, 4400 ] 684 0.091% 100.115% ( 4400, 6600 ] 123 0.016% 100.132% ( 6600, 9900 ] 17 0.002% 100.134% ( 9900, 14000 ] 7 0.001% 100.135% ( 14000, 22000 ] 4 0.001% 100.135% ( 22000, 33000 ] 3 0.000% 100.136% ( 33000, 50000 ] 1 0.000% 100.136% ** Level 4 read latency histogram (micros): Count: 1490310 Average: 25.5280 StdDev: 230.33 Min: 1 Median: 2.1861 Max: 51982 Percentiles: P50: 2.19 P75: 3.19 P99: 546.49 P99.9: 1537.89 P99.99: 1797.16 ------------------------------------------------------ [ 0, 1 ] 19713 1.323% 1.323% ( 1, 2 ] 647088 43.420% 44.742% ######### ( 2, 3 ] 421101 28.256% 72.998% ###### ( 3, 4 ] 157650 10.578% 83.577% ## ( 4, 6 ] 164792 11.058% 94.634% ## ( 6, 10 ] 42453 2.849% 97.483% # ( 10, 15 ] 8133 0.546% 98.029% ( 15, 22 ] 1107 0.074% 98.103% ( 22, 34 ] 81 0.005% 98.108% ( 34, 51 ] 88 0.006% 98.114% ( 51, 76 ] 89 0.006% 98.120% ( 76, 110 ] 237 0.016% 98.136% ( 110, 170 ] 2803 0.188% 98.324% ( 170, 250 ] 3388 0.227% 98.552% ( 250, 380 ] 2923 0.196% 98.748% ( 380, 580 ] 4518 0.303% 99.051% ( 580, 870 ] 5904 0.396% 99.447% ( 870, 1300 ] 5521 0.370% 99.817% ( 1300, 1900 ] 3104 0.208% 100.026% ( 1900, 2900 ] 2170 0.146% 100.171% ( 2900, 4400 ] 1863 0.125% 100.296% ( 4400, 6600 ] 409 0.027% 100.324% ( 6600, 9900 ] 57 0.004% 100.328% ( 9900, 14000 ] 4 0.000% 100.328% ( 14000, 22000 ] 10 0.001% 100.329% ( 22000, 33000 ] 4 0.000% 100.329% ( 33000, 50000 ] 2 0.000% 100.329% ( 50000, 75000 ] 1 0.000% 100.329% ** Level 5 read latency histogram (micros): Count: 17006 Average: 923.4774 StdDev: 1057.06 Min: 87 Median: 604.5258 Max: 19763 Percentiles: P50: 604.53 P75: 1155.38 P99: 5239.94 P99.9: 9391.55 P99.99: 19732.53 ------------------------------------------------------ ( 76, 110 ] 161 0.947% 0.947% ( 110, 170 ] 1975 11.614% 12.560% ## ( 170, 250 ] 2198 12.925% 25.485% ### ( 250, 380 ] 1665 9.791% 35.276% ## ( 380, 580 ] 2265 13.319% 48.595% ### ( 580, 870 ] 2826 16.618% 65.212% ### ( 870, 1300 ] 2508 14.748% 79.960% ### ( 1300, 1900 ] 1432 8.421% 88.381% ## ( 1900, 2900 ] 937 5.510% 93.890% # ( 2900, 4400 ] 788 4.634% 98.524% # ( 4400, 6600 ] 212 1.247% 99.771% ( 6600, 9900 ] 26 0.153% 99.924% ( 9900, 14000 ] 7 0.041% 99.965% ( 14000, 22000 ] 6 0.035% 100.000% ** DB Stats ** Uptime(secs): 12.4 total, 5.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 159.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.719 H:M:S, 38.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 191.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.509 H:M:S, 29.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/19-13:01:59 ... thread 0: (1000000,3000000) ops and (288344.7,190838.1) ops/second in (3.468071,15.720131) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 2.75 GB 219.0 2.0 0.0 2.0 4.7 2.8 0.0 1.7 78.6 188.8 25.59 15.70 46 0.556 2043K 11K 0.0 0.0 L1 4/0 294.35 MB 29.4 0.3 0.2 0.0 0.3 0.2 0.0 1.2 30.9 30.7 9.59 1.44 1 9.587 300K 1847 0.0 0.0 L2 1/0 54.44 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 978.31 MB 1.0 2.0 1.8 0.2 2.0 1.8 0.1 1.1 101.6 99.6 20.56 9.94 7 2.938 1478K 0 0.0 0.0 L4 151/0 9.59 GB 1.0 8.6 2.8 5.7 7.4 1.7 0.1 2.6 134.4 116.6 65.19 36.14 33 1.975 1660K 0 0.0 0.0 L5 148/0 11.69 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 340/8 25.33 GB 0.0 12.9 4.9 7.9 14.4 6.5 2.7 5.2 108.8 122.2 120.93 63.23 87 1.390 5483K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.9 4.9 7.9 14.4 6.5 2.6 5.2 108.8 122.2 120.93 63.23 87 1.390 5483K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.9 4.9 7.9 11.7 3.7 0.0 0.0 123.9 112.4 106.27 55.38 48 2.214 5483K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 193.1 14.66 7.84 39 0.376 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.7 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.43 GB write, 932.86 MB/s write, 12.85 GB read, 830.96 MB/s read, 120.9 seconds Interval compaction: 14.43 GB write, 939.72 MB/s write, 12.85 GB read, 837.07 MB/s read, 120.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 38, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 707428 Average: 32.2717 StdDev: 223.47 Min: 0 Median: 1.6810 Max: 37985 Percentiles: P50: 1.68 P75: 2.47 P99: 806.00 P99.9: 2825.24 P99.99: 3926.69 ------------------------------------------------------ [ 0, 1 ] 88321 12.485% 12.485% ## ( 1, 2 ] 389699 55.087% 67.572% ########### ( 2, 3 ] 110966 15.686% 83.257% ### ( 3, 4 ] 36291 5.130% 88.387% # ( 4, 6 ] 33603 4.750% 93.137% # ( 6, 10 ] 8915 1.260% 94.398% ( 10, 15 ] 1712 0.242% 94.640% ( 15, 22 ] 202 0.029% 94.668% ( 22, 34 ] 24 0.003% 94.672% ( 34, 51 ] 8 0.001% 94.673% ( 51, 76 ] 12 0.002% 94.674% ( 76, 110 ] 737 0.104% 94.779% ( 110, 170 ] 9306 1.315% 96.094% ( 170, 250 ] 9226 1.304% 97.398% ( 250, 380 ] 4333 0.613% 98.011% ( 380, 580 ] 4111 0.581% 98.592% ( 580, 870 ] 3708 0.524% 99.116% ( 870, 1300 ] 2993 0.423% 99.539% ( 1300, 1900 ] 1622 0.229% 99.768% ( 1900, 2900 ] 1009 0.143% 99.911% ( 2900, 4400 ] 820 0.116% 100.027% ( 4400, 6600 ] 160 0.023% 100.049% ( 6600, 9900 ] 13 0.002% 100.051% ( 9900, 14000 ] 4 0.001% 100.052% ( 14000, 22000 ] 7 0.001% 100.053% ( 33000, 50000 ] 1 0.000% 100.053% ** Level 1 read latency histogram (micros): Count: 13284 Average: 49.3880 StdDev: 214.58 Min: 1 Median: 2.4219 Max: 4551 Percentiles: P50: 2.42 P75: 4.05 P99: 867.46 P99.9: 3522.57 P99.99: 4376.54 ------------------------------------------------------ [ 0, 1 ] 57 0.429% 0.429% ( 1, 2 ] 4977 37.466% 37.895% ####### ( 2, 3 ] 3811 28.689% 66.584% ###### ( 3, 4 ] 1089 8.198% 74.782% ## ( 4, 6 ] 1234 9.289% 84.071% ## ( 6, 10 ] 325 2.447% 86.518% ( 10, 15 ] 56 0.422% 86.939% ( 15, 22 ] 5 0.038% 86.977% ( 76, 110 ] 44 0.331% 87.308% ( 110, 170 ] 575 4.329% 91.637% # ( 170, 250 ] 554 4.170% 95.807% # ( 250, 380 ] 189 1.423% 97.230% ( 380, 580 ] 140 1.054% 98.284% ( 580, 870 ] 96 0.723% 99.006% ( 870, 1300 ] 60 0.452% 99.458% ( 1300, 1900 ] 33 0.248% 99.706% ( 1900, 2900 ] 17 0.128% 99.834% ( 2900, 4400 ] 21 0.158% 99.992% ( 4400, 6600 ] 1 0.008% 100.000% ** Level 2 read latency histogram (micros): Count: 410600 Average: 16.4265 StdDev: 187.63 Min: 1 Median: 2.0598 Max: 14959 Percentiles: P50: 2.06 P75: 2.99 P99: 13.71 P99.9: 1269.76 P99.99: 1688.80 ------------------------------------------------------ [ 0, 1 ] 7547 1.838% 1.838% ( 1, 2 ] 191161 46.557% 48.395% ######### ( 2, 3 ] 110218 26.843% 75.238% ##### ( 3, 4 ] 40868 9.953% 85.191% ## ( 4, 6 ] 43122 10.502% 95.693% ## ( 6, 10 ] 11584 2.821% 98.514% # ( 10, 15 ] 2685 0.654% 99.168% ( 15, 22 ] 453 0.110% 99.279% ( 22, 34 ] 54 0.013% 99.292% ( 34, 51 ] 40 0.010% 99.302% ( 51, 76 ] 27 0.007% 99.308% ( 76, 110 ] 28 0.007% 99.315% ( 110, 170 ] 185 0.045% 99.360% ( 170, 250 ] 232 0.057% 99.416% ( 250, 380 ] 283 0.069% 99.485% ( 380, 580 ] 476 0.116% 99.601% ( 580, 870 ] 650 0.158% 99.760% ( 870, 1300 ] 620 0.151% 99.911% ( 1300, 1900 ] 503 0.123% 100.033% ( 1900, 2900 ] 424 0.103% 100.136% ( 2900, 4400 ] 411 0.100% 100.236% ( 4400, 6600 ] 118 0.029% 100.265% ( 6600, 9900 ] 14 0.003% 100.269% ( 9900, 14000 ] 3 0.001% 100.269% ( 14000, 22000 ] 1 0.000% 100.270% ** Level 3 read latency histogram (micros): Count: 753768 Average: 18.0275 StdDev: 198.00 Min: 1 Median: 2.1892 Max: 43801 Percentiles: P50: 2.19 P75: 3.14 P99: 235.12 P99.9: 1799.65 P99.99: 2562.68 ------------------------------------------------------ [ 0, 1 ] 9434 1.252% 1.252% ( 1, 2 ] 326097 43.262% 44.514% ######### ( 2, 3 ] 218533 28.992% 73.506% ###### ( 3, 4 ] 78002 10.348% 83.854% ## ( 4, 6 ] 85016 11.279% 95.133% ## ( 6, 10 ] 21814 2.894% 98.027% # ( 10, 15 ] 4177 0.554% 98.581% ( 15, 22 ] 561 0.074% 98.656% ( 22, 34 ] 39 0.005% 98.661% ( 34, 51 ] 60 0.008% 98.669% ( 51, 76 ] 53 0.007% 98.676% ( 76, 110 ] 172 0.023% 98.699% ( 110, 170 ] 1258 0.167% 98.865% ( 170, 250 ] 1246 0.165% 99.031% ( 250, 380 ] 888 0.118% 99.149% ( 380, 580 ] 1326 0.176% 99.324% ( 580, 870 ] 1756 0.233% 99.557% ( 870, 1300 ] 1722 0.228% 99.786% ( 1300, 1900 ] 1033 0.137% 99.923% ( 1900, 2900 ] 763 0.101% 100.024% ( 2900, 4400 ] 684 0.091% 100.115% ( 4400, 6600 ] 123 0.016% 100.131% ( 6600, 9900 ] 17 0.002% 100.133% ( 9900, 14000 ] 7 0.001% 100.134% ( 14000, 22000 ] 4 0.001% 100.135% ( 22000, 33000 ] 3 0.000% 100.135% ( 33000, 50000 ] 1 0.000% 100.135% ** Level 4 read latency histogram (micros): Count: 1515301 Average: 28.7483 StdDev: 230.59 Min: 1 Median: 2.2155 Max: 51982 Percentiles: P50: 2.22 P75: 3.31 P99: 574.69 P99.9: 1536.94 P99.99: 1799.71 ------------------------------------------------------ [ 0, 1 ] 19713 1.301% 1.301% ( 1, 2 ] 647149 42.708% 44.009% ######### ( 2, 3 ] 421349 27.806% 71.815% ###### ( 3, 4 ] 157810 10.414% 82.229% ## ( 4, 6 ] 165024 10.891% 93.120% ## ( 6, 10 ] 42474 2.803% 95.923% # ( 10, 15 ] 8139 0.537% 96.460% ( 15, 22 ] 1108 0.073% 96.533% ( 22, 34 ] 81 0.005% 96.538% ( 34, 51 ] 88 0.006% 96.544% ( 51, 76 ] 89 0.006% 96.550% ( 76, 110 ] 1125 0.074% 96.624% ( 110, 170 ] 12426 0.820% 97.444% ( 170, 250 ] 11504 0.759% 98.204% ( 250, 380 ] 5763 0.380% 98.584% ( 380, 580 ] 6478 0.428% 99.011% ( 580, 870 ] 6619 0.437% 99.448% ( 870, 1300 ] 5617 0.371% 99.819% ( 1300, 1900 ] 3114 0.206% 100.024% ( 1900, 2900 ] 2183 0.144% 100.168% ( 2900, 4400 ] 1865 0.123% 100.291% ( 4400, 6600 ] 409 0.027% 100.318% ( 6600, 9900 ] 57 0.004% 100.322% ( 9900, 14000 ] 4 0.000% 100.323% ( 14000, 22000 ] 10 0.001% 100.323% ( 22000, 33000 ] 4 0.000% 100.323% ( 33000, 50000 ] 2 0.000% 100.324% ( 50000, 75000 ] 1 0.000% 100.324% ** Level 5 read latency histogram (micros): Count: 33298 Average: 581.7345 StdDev: 838.09 Min: 84 Median: 247.1723 Max: 19763 Percentiles: P50: 247.17 P75: 662.88 P99: 4244.34 P99.9: 7323.72 P99.99: 17560.27 ------------------------------------------------------ ( 76, 110 ] 761 2.285% 2.285% ( 110, 170 ] 8492 25.503% 27.788% ##### ( 170, 250 ] 7667 23.025% 50.814% ##### ( 250, 380 ] 3551 10.664% 61.478% ## ( 380, 580 ] 3568 10.715% 72.194% ## ( 580, 870 ] 3270 9.820% 82.014% ## ( 870, 1300 ] 2569 7.715% 89.729% ## ( 1300, 1900 ] 1440 4.325% 94.054% # ( 1900, 2900 ] 939 2.820% 96.874% # ( 2900, 4400 ] 790 2.373% 99.246% ( 4400, 6600 ] 212 0.637% 99.883% ( 6600, 9900 ] 26 0.078% 99.961% ( 9900, 14000 ] 7 0.021% 99.982% ( 14000, 22000 ] 6 0.018% 100.000% ** DB Stats ** Uptime(secs): 15.8 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 186.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.719 H:M:S, 29.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-13:02:02 ... thread 0: (1000000,4000000) ops and (293321.5,209102.7) ops/second in (3.409229,19.129360) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.73 GB 356.6 3.3 0.0 3.3 7.0 3.7 0.0 1.9 84.0 178.4 40.44 24.16 67 0.604 3448K 18K 0.0 0.0 L1 4/0 294.35 MB 29.4 0.3 0.2 0.0 0.3 0.2 0.0 1.2 30.9 30.7 9.59 1.44 1 9.587 300K 1847 0.0 0.0 L2 1/0 54.44 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 978.31 MB 1.0 2.0 1.8 0.2 2.0 1.8 0.1 1.1 101.6 99.6 20.56 9.94 7 2.938 1478K 0 0.0 0.0 L4 151/0 9.59 GB 1.0 8.6 2.8 5.7 7.4 1.7 0.1 2.6 134.4 116.6 65.19 36.14 33 1.975 1660K 0 0.0 0.0 L5 148/0 11.69 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 341/4 26.31 GB 0.0 14.2 4.9 9.3 16.8 7.5 2.7 4.5 107.1 126.4 135.78 71.68 108 1.257 6888K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.2 4.9 9.3 16.8 7.5 2.6 4.5 107.1 126.4 135.78 71.68 108 1.257 6888K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.2 4.9 9.3 13.0 3.7 0.0 0.0 123.3 112.9 117.98 61.14 53 2.226 6888K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 215.5 17.80 10.54 55 0.324 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.2 total, 19.1 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.76 GB write, 891.43 MB/s write, 14.20 GB read, 755.67 MB/s read, 135.8 seconds Interval compaction: 16.76 GB write, 896.82 MB/s write, 14.20 GB read, 760.24 MB/s read, 135.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 38, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1012395 Average: 25.0855 StdDev: 188.83 Min: 0 Median: 1.6138 Max: 37985 Percentiles: P50: 1.61 P75: 2.22 P99: 577.00 P99.9: 2313.57 P99.99: 3474.38 ------------------------------------------------------ [ 0, 1 ] 152451 15.058% 15.058% ### ( 1, 2 ] 576307 56.925% 71.984% ########### ( 2, 3 ] 140334 13.862% 85.845% ### ( 3, 4 ] 44442 4.390% 90.235% # ( 4, 6 ] 39715 3.923% 94.158% # ( 6, 10 ] 10513 1.038% 95.196% ( 10, 15 ] 2036 0.201% 95.397% ( 15, 22 ] 254 0.025% 95.422% ( 22, 34 ] 29 0.003% 95.425% ( 34, 51 ] 12 0.001% 95.426% ( 51, 76 ] 15 0.001% 95.428% ( 76, 110 ] 1209 0.119% 95.547% ( 110, 170 ] 13108 1.295% 96.842% ( 170, 250 ] 11827 1.168% 98.010% ( 250, 380 ] 5295 0.523% 98.533% ( 380, 580 ] 4796 0.474% 99.007% ( 580, 870 ] 3949 0.390% 99.397% ( 870, 1300 ] 3040 0.300% 99.697% ( 1300, 1900 ] 1630 0.161% 99.858% ( 1900, 2900 ] 1017 0.100% 99.959% ( 2900, 4400 ] 822 0.081% 100.040% ( 4400, 6600 ] 160 0.016% 100.056% ( 6600, 9900 ] 13 0.001% 100.057% ( 9900, 14000 ] 4 0.000% 100.058% ( 14000, 22000 ] 7 0.001% 100.058% ( 33000, 50000 ] 1 0.000% 100.058% ** Level 1 read latency histogram (micros): Count: 14347 Average: 62.0822 StdDev: 215.18 Min: 1 Median: 2.5614 Max: 4551 Percentiles: P50: 2.56 P75: 5.34 P99: 857.21 P99.9: 3446.64 P99.99: 4368.95 ------------------------------------------------------ [ 0, 1 ] 57 0.397% 0.397% ( 1, 2 ] 4977 34.690% 35.087% ####### ( 2, 3 ] 3811 26.563% 61.651% ##### ( 3, 4 ] 1089 7.590% 69.241% ## ( 4, 6 ] 1234 8.601% 77.842% ## ( 6, 10 ] 325 2.265% 80.107% ( 10, 15 ] 56 0.390% 80.498% ( 15, 22 ] 5 0.035% 80.533% ( 76, 110 ] 125 0.871% 81.404% ( 110, 170 ] 1032 7.193% 88.597% # ( 170, 250 ] 836 5.827% 94.424% # ( 250, 380 ] 314 2.189% 96.613% ( 380, 580 ] 224 1.561% 98.174% ( 580, 870 ] 124 0.864% 99.038% ( 870, 1300 ] 64 0.446% 99.484% ( 1300, 1900 ] 35 0.244% 99.728% ( 1900, 2900 ] 17 0.118% 99.847% ( 2900, 4400 ] 21 0.146% 99.993% ( 4400, 6600 ] 1 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 410877 Average: 16.5740 StdDev: 187.73 Min: 1 Median: 2.0611 Max: 14959 Percentiles: P50: 2.06 P75: 2.99 P99: 14.22 P99.9: 1270.41 P99.99: 1689.96 ------------------------------------------------------ [ 0, 1 ] 7547 1.837% 1.837% ( 1, 2 ] 191161 46.525% 48.362% ######### ( 2, 3 ] 110218 26.825% 75.187% ##### ( 3, 4 ] 40868 9.947% 85.134% ## ( 4, 6 ] 43122 10.495% 95.629% ## ( 6, 10 ] 11584 2.819% 98.448% # ( 10, 15 ] 2685 0.653% 99.101% ( 15, 22 ] 453 0.110% 99.212% ( 22, 34 ] 54 0.013% 99.225% ( 34, 51 ] 40 0.010% 99.235% ( 51, 76 ] 27 0.007% 99.241% ( 76, 110 ] 49 0.012% 99.253% ( 110, 170 ] 304 0.074% 99.327% ( 170, 250 ] 301 0.073% 99.400% ( 250, 380 ] 316 0.077% 99.477% ( 380, 580 ] 496 0.121% 99.598% ( 580, 870 ] 661 0.161% 99.759% ( 870, 1300 ] 623 0.152% 99.910% ( 1300, 1900 ] 503 0.122% 100.033% ( 1900, 2900 ] 425 0.103% 100.136% ( 2900, 4400 ] 411 0.100% 100.236% ( 4400, 6600 ] 118 0.029% 100.265% ( 6600, 9900 ] 14 0.003% 100.268% ( 9900, 14000 ] 3 0.001% 100.269% ( 14000, 22000 ] 1 0.000% 100.269% ** Level 3 read latency histogram (micros): Count: 755990 Average: 18.6272 StdDev: 198.23 Min: 1 Median: 2.1943 Max: 43801 Percentiles: P50: 2.19 P75: 3.17 P99: 274.25 P99.9: 1799.62 P99.99: 2564.14 ------------------------------------------------------ [ 0, 1 ] 9434 1.248% 1.248% ( 1, 2 ] 326097 43.135% 44.383% ######### ( 2, 3 ] 218533 28.907% 73.290% ###### ( 3, 4 ] 78002 10.318% 83.608% ## ( 4, 6 ] 85016 11.246% 94.853% ## ( 6, 10 ] 21814 2.885% 97.739% # ( 10, 15 ] 4177 0.553% 98.291% ( 15, 22 ] 561 0.074% 98.366% ( 22, 34 ] 39 0.005% 98.371% ( 34, 51 ] 60 0.008% 98.379% ( 51, 76 ] 53 0.007% 98.386% ( 76, 110 ] 328 0.043% 98.429% ( 110, 170 ] 2228 0.295% 98.724% ( 170, 250 ] 1887 0.250% 98.973% ( 250, 380 ] 1078 0.143% 99.116% ( 380, 580 ] 1495 0.198% 99.314% ( 580, 870 ] 1832 0.242% 99.556% ( 870, 1300 ] 1739 0.230% 99.786% ( 1300, 1900 ] 1034 0.137% 99.923% ( 1900, 2900 ] 764 0.101% 100.024% ( 2900, 4400 ] 685 0.091% 100.115% ( 4400, 6600 ] 123 0.016% 100.131% ( 6600, 9900 ] 17 0.002% 100.133% ( 9900, 14000 ] 7 0.001% 100.134% ( 14000, 22000 ] 4 0.001% 100.135% ( 22000, 33000 ] 3 0.000% 100.135% ( 33000, 50000 ] 1 0.000% 100.135% ** Level 4 read latency histogram (micros): Count: 1539152 Average: 31.7219 StdDev: 230.86 Min: 1 Median: 2.2438 Max: 51982 Percentiles: P50: 2.24 P75: 3.42 P99: 596.40 P99.9: 1536.60 P99.99: 1802.22 ------------------------------------------------------ [ 0, 1 ] 19713 1.281% 1.281% ( 1, 2 ] 647149 42.046% 43.327% ######## ( 2, 3 ] 421349 27.375% 70.702% ##### ( 3, 4 ] 157810 10.253% 80.955% ## ( 4, 6 ] 165024 10.722% 91.677% ## ( 6, 10 ] 42474 2.760% 94.436% # ( 10, 15 ] 8139 0.529% 94.965% ( 15, 22 ] 1108 0.072% 95.037% ( 22, 34 ] 81 0.005% 95.042% ( 34, 51 ] 88 0.006% 95.048% ( 51, 76 ] 89 0.006% 95.054% ( 76, 110 ] 2659 0.173% 95.227% ( 110, 170 ] 22912 1.489% 96.715% ( 170, 250 ] 18180 1.181% 97.896% ( 250, 380 ] 8168 0.531% 98.427% ( 380, 580 ] 8406 0.546% 98.973% ( 580, 870 ] 7276 0.473% 99.446% ( 870, 1300 ] 5754 0.374% 99.820% ( 1300, 1900 ] 3129 0.203% 100.023% ( 1900, 2900 ] 2192 0.142% 100.166% ( 2900, 4400 ] 1869 0.121% 100.287% ( 4400, 6600 ] 409 0.027% 100.314% ( 6600, 9900 ] 57 0.004% 100.317% ( 9900, 14000 ] 4 0.000% 100.318% ( 14000, 22000 ] 10 0.001% 100.318% ( 22000, 33000 ] 4 0.000% 100.318% ( 33000, 50000 ] 2 0.000% 100.319% ( 50000, 75000 ] 1 0.000% 100.319% ** Level 5 read latency histogram (micros): Count: 48908 Average: 466.2759 StdDev: 717.81 Min: 83 Median: 218.2295 Max: 19763 Percentiles: P50: 218.23 P75: 478.53 P99: 3949.09 P99.9: 6497.18 P99.99: 15478.93 ------------------------------------------------------ ( 76, 110 ] 1787 3.654% 3.654% # ( 110, 170 ] 15438 31.565% 35.219% ###### ( 170, 250 ] 11991 24.517% 59.737% ##### ( 250, 380 ] 5120 10.469% 70.205% ## ( 380, 580 ] 4760 9.733% 79.938% ## ( 580, 870 ] 3712 7.590% 87.528% ## ( 870, 1300 ] 2651 5.420% 92.948% # ( 1300, 1900 ] 1453 2.971% 95.919% # ( 1900, 2900 ] 953 1.949% 97.867% ( 2900, 4400 ] 792 1.619% 99.487% ( 4400, 6600 ] 212 0.433% 99.920% ( 6600, 9900 ] 26 0.053% 99.973% ( 9900, 14000 ] 7 0.014% 99.988% ( 14000, 22000 ] 6 0.012% 100.000% ** DB Stats ** Uptime(secs): 19.2 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 204.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.719 H:M:S, 24.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 494.688 micros/op 8077 ops/sec 20.056 seconds 161996 operations; 7.8 MB/s (39999 of 39999 found) Microseconds per read: Count: 161996 Average: 494.7030 StdDev: 1139.59 Min: 2 Median: 242.3492 Max: 81698 Percentiles: P50: 242.35 P75: 486.66 P99: 3944.50 P99.9: 18477.36 P99.99: 36589.27 ------------------------------------------------------ ( 1, 2 ] 2 0.001% 0.001% ( 2, 3 ] 21 0.013% 0.014% ( 3, 4 ] 71 0.044% 0.058% ( 4, 6 ] 150 0.093% 0.151% ( 6, 10 ] 310 0.191% 0.342% ( 10, 15 ] 736 0.454% 0.796% ( 15, 22 ] 2282 1.409% 2.205% ( 22, 34 ] 3458 2.135% 4.340% ( 34, 51 ] 2393 1.477% 5.817% ( 51, 76 ] 331 0.204% 6.021% ( 76, 110 ] 218 0.135% 6.156% ( 110, 170 ] 22817 14.085% 20.241% ### ( 170, 250 ] 53307 32.906% 53.147% ####### ( 250, 380 ] 25414 15.688% 68.835% ### ( 380, 580 ] 18726 11.560% 80.395% ## ( 580, 870 ] 13104 8.089% 88.484% ## ( 870, 1300 ] 8438 5.209% 93.692% # ( 1300, 1900 ] 4286 2.646% 96.338% # ( 1900, 2900 ] 2801 1.729% 98.067% ( 2900, 4400 ] 2170 1.340% 99.407% ( 4400, 6600 ] 536 0.331% 99.738% ( 6600, 9900 ] 136 0.084% 99.822% ( 9900, 14000 ] 66 0.041% 99.862% ( 14000, 22000 ] 109 0.067% 99.930% ( 22000, 33000 ] 94 0.058% 99.988% ( 33000, 50000 ] 18 0.011% 99.999% ( 50000, 75000 ] 1 0.001% 99.999% ( 75000, 110000 ] 1 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2434559 rocksdb.bloom.filter.full.positive COUNT : 184841 rocksdb.bloom.filter.full.true.positive COUNT : 161134 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 862 rocksdb.memtable.miss COUNT : 161134 rocksdb.l0.hit COUNT : 18659 rocksdb.l1.hit COUNT : 1818 rocksdb.l2andup.hit COUNT : 140657 rocksdb.compaction.key.drop.new COUNT : 1244443 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4223171 rocksdb.number.keys.read COUNT : 161996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4358312472 rocksdb.bytes.read COUNT : 161996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 536 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4887879 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 15744645659 rocksdb.compact.write.bytes COUNT : 14463078421 rocksdb.flush.write.bytes COUNT : 4286789822 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 30 rocksdb.number.superversion_acquires COUNT : 753 rocksdb.number.superversion_releases COUNT : 735 rocksdb.number.superversion_cleanups COUNT : 190 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 190 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4259135488 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7994368 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16193473534 rocksdb.non.last.level.read.count COUNT : 3883889 rocksdb.block.checksum.compute.count COUNT : 4002290 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 241.626450 P95 : 1595.473020 P99 : 3943.596127 P100 : 81697.000000 COUNT : 161996 SUM : 79971696 rocksdb.db.write.micros P50 : 1.521614 P95 : 3.927947 P99 : 5.812863 P100 : 821373.000000 COUNT : 4223171 SUM : 15031387 rocksdb.compaction.times.micros P50 : 1955555.555556 P95 : 4177500.000000 P99 : 8909000.000000 P100 : 9586770.000000 COUNT : 54 SUM : 118950872 rocksdb.compaction.times.cpu_micros P50 : 1111851.851852 P95 : 1837368.421053 P99 : 1971879.000000 P100 : 1971879.000000 COUNT : 54 SUM : 62102520 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1138.750000 P95 : 155750.000000 P99 : 215520.000000 P100 : 215520.000000 COUNT : 59 SUM : 1253398 rocksdb.compaction.outfile.sync.micros P50 : 34214.285714 P95 : 159375.000000 P99 : 613500.000000 P100 : 939453.000000 COUNT : 185 SUM : 10798759 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 238.333333 P95 : 3467.857143 P99 : 6006.000000 P100 : 40000.000000 COUNT : 127 SUM : 137267 rocksdb.table.open.io.micros P50 : 7542.857143 P95 : 20766.666667 P99 : 27868.000000 P100 : 27868.000000 COUNT : 536 SUM : 4371868 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.170564 P95 : 9.438277 P99 : 166.203910 P100 : 43807.000000 COUNT : 3814669 SUM : 61081679 rocksdb.read.block.get.micros P50 : 199.572690 P95 : 1370.668715 P99 : 3609.243934 P100 : 51989.000000 COUNT : 187371 SUM : 72546713 rocksdb.write.raw.block.micros P50 : 0.522254 P95 : 0.992283 P99 : 3.912961 P100 : 34548.000000 COUNT : 4542501 SUM : 14506062 rocksdb.numfiles.in.singlecompaction P50 : 3.266667 P95 : 3.946667 P99 : 4.640000 P100 : 5.000000 COUNT : 68 SUM : 237 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561820 P95 : 1148.376866 P99 : 2711.538462 P100 : 821197.000000 COUNT : 1445 SUM : 4887933 rocksdb.sst.read.micros P50 : 1.968060 P95 : 119.938834 P99 : 773.286837 P100 : 51982.000000 COUNT : 3884386 SUM : 122429597 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 161996 SUM : 161996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4223171 SUM : 4358312472 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 224883.720930 P95 : 949250.000000 P99 : 1049880.000000 P100 : 1049880.000000 COUNT : 59 SUM : 18576587 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 194 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0