[2024-07-25 09:59:27.182805] Starting SPDK v24.09-pre git sha1 2cee1c4d1 / DPDK 24.03.0 initialization... [2024-07-25 09:59:27.183130] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843050 ] Set seed to 1721894367175433 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-25 09:59:27.340488] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-25 09:59:27.565552] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-25 09:59:27.565603] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 843050' to capture a snapshot of events at runtime. [2024-07-25 09:59:27.565616] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-25 09:59:27.565630] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-25 09:59:27.565640] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid843050 for offline analysis/debug. [2024-07-25 09:59:27.565736] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Jul 25 09:59:31 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/25-09:59:38 ... thread 0: (1000000,1000000) ops and (142475.2,142475.2) ops/second in (7.018763,7.018763) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.28 GB 43.8 0.3 0.0 0.3 1.1 0.8 0.0 1.4 35.7 128.5 8.79 4.23 11 0.800 319K 1818 0.0 0.0 L1 3/3 167.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/1 128.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 28/9 1.63 GB 1.1 2.1 1.6 0.5 2.1 1.5 0.0 1.3 100.6 98.9 21.29 11.38 10 2.129 1664K 9928 0.0 0.0 L4 163/27 11.83 GB 1.0 2.7 1.6 1.1 2.6 1.5 0.1 1.6 106.7 102.8 25.98 14.85 13 1.998 617K 0 0.0 0.0 L5 120/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 327/49 24.25 GB 0.0 5.1 3.2 1.9 5.8 3.9 0.1 7.2 93.3 105.3 56.07 30.46 34 1.649 2601K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 3.2 1.9 5.8 3.9 0.1 7.2 93.3 105.3 56.07 30.46 34 1.649 2601K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 3.2 1.9 5.0 3.1 0.0 0.0 105.3 102.5 49.66 27.85 24 2.069 2601K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 127.5 6.41 2.61 10 0.641 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.1 total, 7.0 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.77 GB write, 830.43 MB/s write, 5.11 GB read, 735.29 MB/s read, 56.1 seconds Interval compaction: 5.77 GB write, 841.00 MB/s write, 5.11 GB read, 744.66 MB/s read, 56.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 205473 Average: 39.1961 StdDev: 427.52 Min: 1 Median: 2.2338 Max: 43854 Percentiles: P50: 2.23 P75: 3.28 P99: 879.24 P99.9: 4228.61 P99.99: 8903.74 ------------------------------------------------------ [ 0, 1 ] 3528 1.717% 1.717% ( 1, 2 ] 85248 41.489% 43.206% ######## ( 2, 3 ] 59701 29.055% 72.261% ###### ( 3, 4 ] 19910 9.690% 81.951% ## ( 4, 6 ] 23358 11.368% 93.319% ## ( 6, 10 ] 6377 3.104% 96.422% # ( 10, 15 ] 1374 0.669% 97.091% ( 15, 22 ] 215 0.105% 97.196% ( 22, 34 ] 25 0.012% 97.208% ( 34, 51 ] 17 0.008% 97.216% ( 51, 76 ] 37 0.018% 97.234% ( 76, 110 ] 9 0.004% 97.239% ( 110, 170 ] 35 0.017% 97.256% ( 170, 250 ] 134 0.065% 97.321% ( 250, 380 ] 606 0.295% 97.616% ( 380, 580 ] 1349 0.657% 98.272% ( 580, 870 ] 1479 0.720% 98.992% ( 870, 1300 ] 803 0.391% 99.383% ( 1300, 1900 ] 325 0.158% 99.541% ( 1900, 2900 ] 324 0.158% 99.699% ( 2900, 4400 ] 468 0.228% 99.927% ( 4400, 6600 ] 114 0.055% 99.982% ( 6600, 9900 ] 25 0.012% 99.994% ( 9900, 14000 ] 10 0.005% 99.999% ( 14000, 22000 ] 23 0.011% 100.010% ( 22000, 33000 ] 10 0.005% 100.015% ( 33000, 50000 ] 5 0.002% 100.018% ** Level 1 read latency histogram (micros): Count: 20166 Average: 26.4426 StdDev: 322.92 Min: 1 Median: 2.4925 Max: 21833 Percentiles: P50: 2.49 P75: 3.69 P99: 689.99 P99.9: 4102.43 P99.99: 13977.31 ------------------------------------------------------ [ 0, 1 ] 87 0.431% 0.431% ( 1, 2 ] 6702 33.234% 33.666% ####### ( 2, 3 ] 6689 33.170% 66.835% ####### ( 3, 4 ] 2384 11.822% 78.657% ## ( 4, 6 ] 3070 15.224% 93.881% ### ( 6, 10 ] 732 3.630% 97.511% # ( 10, 15 ] 142 0.704% 98.215% ( 15, 22 ] 24 0.119% 98.334% ( 22, 34 ] 1 0.005% 98.339% ( 34, 51 ] 5 0.025% 98.364% ( 51, 76 ] 1 0.005% 98.369% ( 110, 170 ] 4 0.020% 98.388% ( 170, 250 ] 6 0.030% 98.418% ( 250, 380 ] 16 0.079% 98.497% ( 380, 580 ] 60 0.298% 98.795% ( 580, 870 ] 109 0.541% 99.336% ( 870, 1300 ] 60 0.298% 99.633% ( 1300, 1900 ] 15 0.074% 99.707% ( 1900, 2900 ] 22 0.109% 99.817% ( 2900, 4400 ] 21 0.104% 99.921% ( 4400, 6600 ] 8 0.040% 99.960% ( 6600, 9900 ] 3 0.015% 99.975% ( 9900, 14000 ] 3 0.015% 99.990% ( 14000, 22000 ] 2 0.010% 100.000% ** Level 2 read latency histogram (micros): Count: 344853 Average: 17.6288 StdDev: 336.73 Min: 1 Median: 2.3088 Max: 43954 Percentiles: P50: 2.31 P75: 3.37 P99: 13.60 P99.9: 1900.54 P99.99: 3081.82 ------------------------------------------------------ [ 0, 1 ] 3383 0.981% 0.981% ( 1, 2 ] 136920 39.704% 40.685% ######## ( 2, 3 ] 104011 30.161% 70.846% ###### ( 3, 4 ] 38819 11.257% 82.103% ## ( 4, 6 ] 44880 13.014% 95.117% ### ( 6, 10 ] 11112 3.222% 98.339% # ( 10, 15 ] 3165 0.918% 99.257% ( 15, 22 ] 530 0.154% 99.410% ( 22, 34 ] 74 0.021% 99.432% ( 34, 51 ] 52 0.015% 99.447% ( 51, 76 ] 51 0.015% 99.462% ( 76, 110 ] 20 0.006% 99.468% ( 110, 170 ] 28 0.008% 99.476% ( 170, 250 ] 38 0.011% 99.487% ( 250, 380 ] 240 0.070% 99.556% ( 380, 580 ] 449 0.130% 99.687% ( 580, 870 ] 353 0.102% 99.789% ( 870, 1300 ] 204 0.059% 99.848% ( 1300, 1900 ] 179 0.052% 99.900% ( 1900, 2900 ] 271 0.079% 99.979% ( 2900, 4400 ] 326 0.095% 100.073% ( 4400, 6600 ] 108 0.031% 100.104% ( 6600, 9900 ] 54 0.016% 100.120% ( 9900, 14000 ] 14 0.004% 100.124% ( 14000, 22000 ] 21 0.006% 100.130% ( 22000, 33000 ] 17 0.005% 100.135% ( 33000, 50000 ] 4 0.001% 100.136% ** Level 3 read latency histogram (micros): Count: 560805 Average: 20.9707 StdDev: 392.31 Min: 1 Median: 2.3652 Max: 51349 Percentiles: P50: 2.37 P75: 3.42 P99: 14.50 P99.9: 1709.90 P99.99: 2982.98 ------------------------------------------------------ [ 0, 1 ] 4329 0.772% 0.772% ( 1, 2 ] 210952 37.616% 38.388% ######## ( 2, 3 ] 178333 31.799% 70.187% ###### ( 3, 4 ] 64583 11.516% 81.703% ## ( 4, 6 ] 74631 13.308% 95.011% ### ( 6, 10 ] 18357 3.273% 98.285% # ( 10, 15 ] 4459 0.795% 99.080% ( 15, 22 ] 602 0.107% 99.187% ( 22, 34 ] 100 0.018% 99.205% ( 34, 51 ] 103 0.018% 99.223% ( 51, 76 ] 91 0.016% 99.239% ( 76, 110 ] 37 0.007% 99.246% ( 110, 170 ] 68 0.012% 99.258% ( 170, 250 ] 154 0.027% 99.286% ( 250, 380 ] 498 0.089% 99.374% ( 380, 580 ] 1025 0.183% 99.557% ( 580, 870 ] 1068 0.190% 99.748% ( 870, 1300 ] 640 0.114% 99.862% ( 1300, 1900 ] 315 0.056% 99.918% ( 1900, 2900 ] 373 0.067% 99.984% ( 2900, 4400 ] 577 0.103% 100.087% ( 4400, 6600 ] 156 0.028% 100.115% ( 6600, 9900 ] 66 0.012% 100.127% ( 9900, 14000 ] 31 0.006% 100.132% ( 14000, 22000 ] 74 0.013% 100.146% ( 22000, 33000 ] 48 0.009% 100.154% ( 33000, 50000 ] 3 0.001% 100.155% ( 50000, 75000 ] 1 0.000% 100.155% ** Level 4 read latency histogram (micros): Count: 612486 Average: 29.9185 StdDev: 384.62 Min: 1 Median: 2.4237 Max: 62335 Percentiles: P50: 2.42 P75: 3.58 P99: 553.95 P99.9: 1603.36 P99.99: 2145.94 ------------------------------------------------------ [ 0, 1 ] 4390 0.717% 0.717% ( 1, 2 ] 220947 36.074% 36.791% ####### ( 2, 3 ] 190950 31.176% 67.967% ###### ( 3, 4 ] 74283 12.128% 80.095% ## ( 4, 6 ] 85048 13.886% 93.981% ### ( 6, 10 ] 19904 3.250% 97.230% # ( 10, 15 ] 5040 0.823% 98.053% ( 15, 22 ] 740 0.121% 98.174% ( 22, 34 ] 100 0.016% 98.190% ( 34, 51 ] 196 0.032% 98.222% ( 51, 76 ] 197 0.032% 98.254% ( 76, 110 ] 63 0.010% 98.265% ( 110, 170 ] 121 0.020% 98.285% ( 170, 250 ] 420 0.069% 98.353% ( 250, 380 ] 1369 0.224% 98.577% ( 380, 580 ] 2986 0.488% 99.064% ( 580, 870 ] 3108 0.507% 99.572% ( 870, 1300 ] 1653 0.270% 99.841% ( 1300, 1900 ] 717 0.117% 99.959% ( 1900, 2900 ] 800 0.131% 100.089% ( 2900, 4400 ] 942 0.154% 100.243% ( 4400, 6600 ] 288 0.047% 100.290% ( 6600, 9900 ] 64 0.010% 100.300% ( 9900, 14000 ] 25 0.004% 100.304% ( 14000, 22000 ] 35 0.006% 100.310% ( 22000, 33000 ] 24 0.004% 100.314% ( 33000, 50000 ] 11 0.002% 100.316% ( 50000, 75000 ] 2 0.000% 100.316% ** Level 5 read latency histogram (micros): Count: 7580 Average: 1274.5352 StdDev: 2654.15 Min: 107 Median: 690.6559 Max: 49967 Percentiles: P50: 690.66 P75: 1162.04 P99: 8162.00 P99.9: 41946.25 P99.99: 49194.62 ------------------------------------------------------ ( 76, 110 ] 2 0.026% 0.026% ( 110, 170 ] 41 0.541% 0.567% ( 170, 250 ] 233 3.074% 3.641% # ( 250, 380 ] 869 11.464% 15.106% ## ( 380, 580 ] 1912 25.224% 40.330% ##### ( 580, 870 ] 1921 25.343% 65.673% ##### ( 870, 1300 ] 1041 13.734% 79.406% ### ( 1300, 1900 ] 397 5.237% 84.644% # ( 1900, 2900 ] 402 5.303% 89.947% # ( 2900, 4400 ] 526 6.939% 96.887% # ( 4400, 6600 ] 146 1.926% 98.813% ( 6600, 9900 ] 30 0.396% 99.208% ( 9900, 14000 ] 7 0.092% 99.301% ( 14000, 22000 ] 17 0.224% 99.525% ( 22000, 33000 ] 20 0.264% 99.789% ( 33000, 50000 ] 16 0.211% 100.000% ** DB Stats ** Uptime(secs): 7.1 total, 7.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 138.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.031 H:M:S, 28.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 140.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.031 H:M:S, 28.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/25-09:59:43 ... thread 0: (1000000,2000000) ops and (202449.0,167248.1) ops/second in (4.939516,11.958279) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 1.84 GB 106.3 0.9 0.0 0.9 2.8 1.8 0.0 1.5 50.5 151.3 18.66 10.16 28 0.666 957K 5722 0.0 0.0 L1 4/0 316.96 MB 31.7 0.6 0.5 0.2 0.6 0.5 0.0 1.3 67.0 66.2 9.85 3.74 1 9.846 670K 8300 0.0 0.0 L2 1/0 54.09 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/1 1.02 GB 1.0 2.3 1.7 0.6 2.3 1.7 0.3 1.3 103.9 102.2 22.79 12.43 11 2.072 1895K 13K 0.0 0.0 L4 150/4 9.92 GB 1.0 7.8 2.5 5.2 6.8 1.6 0.2 2.7 139.8 123.0 56.92 36.03 28 2.033 1532K 0 0.0 0.0 L5 150/0 11.32 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 337/17 24.45 GB 0.0 11.6 4.7 6.9 12.5 5.6 2.9 6.8 110.2 118.4 108.22 62.37 68 1.591 5056K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.6 4.7 6.9 12.5 5.6 2.9 6.8 110.2 118.4 108.22 62.37 68 1.591 5056K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.6 4.7 6.9 10.7 3.7 0.0 0.0 122.9 112.6 97.02 56.55 43 2.256 5056K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 168.5 11.20 5.82 25 0.448 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.0 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.51 GB write, 1062.90 MB/s write, 11.65 GB read, 989.89 MB/s read, 108.2 seconds Interval compaction: 12.51 GB write, 1070.84 MB/s write, 11.65 GB read, 997.29 MB/s read, 108.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 480950 Average: 38.8799 StdDev: 341.39 Min: 1 Median: 2.0522 Max: 43854 Percentiles: P50: 2.05 P75: 3.03 P99: 826.79 P99.9: 3519.89 P99.99: 4313.64 ------------------------------------------------------ [ 0, 1 ] 13474 2.802% 2.802% # ( 1, 2 ] 220447 45.836% 48.637% ######### ( 2, 3 ] 125645 26.124% 74.762% ##### ( 3, 4 ] 41957 8.724% 83.485% ## ( 4, 6 ] 43185 8.979% 92.464% ## ( 6, 10 ] 11533 2.398% 94.862% ( 10, 15 ] 2425 0.504% 95.367% ( 15, 22 ] 329 0.068% 95.435% ( 22, 34 ] 46 0.010% 95.445% ( 34, 51 ] 26 0.005% 95.450% ( 51, 76 ] 50 0.010% 95.460% ( 76, 110 ] 18 0.004% 95.464% ( 110, 170 ] 757 0.157% 95.622% ( 170, 250 ] 3879 0.807% 96.428% ( 250, 380 ] 4571 0.950% 97.379% ( 380, 580 ] 4604 0.957% 98.336% ( 580, 870 ] 3755 0.781% 99.117% ( 870, 1300 ] 1976 0.411% 99.527% ( 1300, 1900 ] 747 0.155% 99.683% ( 1900, 2900 ] 708 0.147% 99.830% ( 2900, 4400 ] 818 0.170% 100.000% ( 4400, 6600 ] 173 0.036% 100.036% ( 6600, 9900 ] 39 0.008% 100.044% ( 9900, 14000 ] 18 0.004% 100.048% ( 14000, 22000 ] 28 0.006% 100.054% ( 22000, 33000 ] 10 0.002% 100.056% ( 33000, 50000 ] 7 0.001% 100.057% ** Level 1 read latency histogram (micros): Count: 43618 Average: 25.0947 StdDev: 247.81 Min: 1 Median: 2.5935 Max: 21833 Percentiles: P50: 2.59 P75: 3.94 P99: 564.46 P99.9: 3087.89 P99.99: 11579.15 ------------------------------------------------------ [ 0, 1 ] 181 0.415% 0.415% ( 1, 2 ] 13240 30.354% 30.769% ###### ( 2, 3 ] 14132 32.399% 63.169% ###### ( 3, 4 ] 5493 12.593% 75.762% ### ( 4, 6 ] 6825 15.647% 91.410% ### ( 6, 10 ] 1840 4.218% 95.628% # ( 10, 15 ] 374 0.857% 96.485% ( 15, 22 ] 84 0.193% 96.678% ( 22, 34 ] 4 0.009% 96.687% ( 34, 51 ] 13 0.030% 96.717% ( 51, 76 ] 9 0.021% 96.738% ( 76, 110 ] 5 0.011% 96.749% ( 110, 170 ] 91 0.209% 96.958% ( 170, 250 ] 332 0.761% 97.719% ( 250, 380 ] 343 0.786% 98.505% ( 380, 580 ] 234 0.536% 99.042% ( 580, 870 ] 199 0.456% 99.498% ( 870, 1300 ] 104 0.238% 99.736% ( 1300, 1900 ] 31 0.071% 99.807% ( 1900, 2900 ] 37 0.085% 99.892% ( 2900, 4400 ] 27 0.062% 99.954% ( 4400, 6600 ] 11 0.025% 99.979% ( 6600, 9900 ] 3 0.007% 99.986% ( 9900, 14000 ] 4 0.009% 99.995% ( 14000, 22000 ] 2 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 377598 Average: 16.8811 StdDev: 323.67 Min: 1 Median: 2.3264 Max: 43954 Percentiles: P50: 2.33 P75: 3.40 P99: 13.53 P99.9: 1908.37 P99.99: 3142.99 ------------------------------------------------------ [ 0, 1 ] 3473 0.920% 0.920% ( 1, 2 ] 147843 39.154% 40.073% ######## ( 2, 3 ] 114853 30.417% 70.490% ###### ( 3, 4 ] 42887 11.358% 81.848% ## ( 4, 6 ] 49934 13.224% 95.072% ### ( 6, 10 ] 12386 3.280% 98.352% # ( 10, 15 ] 3464 0.917% 99.270% ( 15, 22 ] 573 0.152% 99.421% ( 22, 34 ] 78 0.021% 99.442% ( 34, 51 ] 61 0.016% 99.458% ( 51, 76 ] 59 0.016% 99.474% ( 76, 110 ] 24 0.006% 99.480% ( 110, 170 ] 30 0.008% 99.488% ( 170, 250 ] 40 0.011% 99.499% ( 250, 380 ] 244 0.065% 99.563% ( 380, 580 ] 483 0.128% 99.691% ( 580, 870 ] 376 0.100% 99.791% ( 870, 1300 ] 222 0.059% 99.850% ( 1300, 1900 ] 188 0.050% 99.899% ( 1900, 2900 ] 287 0.076% 99.975% ( 2900, 4400 ] 341 0.090% 100.066% ( 4400, 6600 ] 112 0.030% 100.095% ( 6600, 9900 ] 54 0.014% 100.110% ( 9900, 14000 ] 14 0.004% 100.113% ( 14000, 22000 ] 21 0.006% 100.119% ( 22000, 33000 ] 17 0.005% 100.123% ( 33000, 50000 ] 4 0.001% 100.124% ** Level 3 read latency histogram (micros): Count: 764249 Average: 18.6160 StdDev: 342.91 Min: 1 Median: 2.3374 Max: 51349 Percentiles: P50: 2.34 P75: 3.37 P99: 18.49 P99.9: 1485.84 P99.99: 2805.72 ------------------------------------------------------ [ 0, 1 ] 6973 0.912% 0.912% ( 1, 2 ] 294340 38.514% 39.426% ######## ( 2, 3 ] 239494 31.337% 70.763% ###### ( 3, 4 ] 86610 11.333% 82.096% ## ( 4, 6 ] 98458 12.883% 94.979% ### ( 6, 10 ] 24637 3.224% 98.203% # ( 10, 15 ] 5713 0.748% 98.950% ( 15, 22 ] 765 0.100% 99.050% ( 22, 34 ] 123 0.016% 99.066% ( 34, 51 ] 146 0.019% 99.085% ( 51, 76 ] 136 0.018% 99.103% ( 76, 110 ] 56 0.007% 99.110% ( 110, 170 ] 174 0.023% 99.133% ( 170, 250 ] 715 0.094% 99.227% ( 250, 380 ] 1097 0.144% 99.370% ( 380, 580 ] 1572 0.206% 99.576% ( 580, 870 ] 1460 0.191% 99.767% ( 870, 1300 ] 890 0.116% 99.884% ( 1300, 1900 ] 406 0.053% 99.937% ( 1900, 2900 ] 450 0.059% 99.996% ( 2900, 4400 ] 651 0.085% 100.081% ( 4400, 6600 ] 166 0.022% 100.102% ( 6600, 9900 ] 69 0.009% 100.111% ( 9900, 14000 ] 33 0.004% 100.116% ( 14000, 22000 ] 76 0.010% 100.126% ( 22000, 33000 ] 48 0.006% 100.132% ( 33000, 50000 ] 3 0.000% 100.132% ( 50000, 75000 ] 1 0.000% 100.133% ** Level 4 read latency histogram (micros): Count: 1452710 Average: 21.9100 StdDev: 280.04 Min: 1 Median: 2.3080 Max: 62335 Percentiles: P50: 2.31 P75: 3.39 P99: 384.66 P99.9: 1083.16 P99.99: 1288.49 ------------------------------------------------------ [ 0, 1 ] 14109 0.971% 0.971% ( 1, 2 ] 578876 39.848% 40.819% ######## ( 2, 3 ] 432981 29.805% 70.624% ###### ( 3, 4 ] 164196 11.303% 81.927% ## ( 4, 6 ] 177737 12.235% 94.162% ## ( 6, 10 ] 44890 3.090% 97.252% # ( 10, 15 ] 10161 0.699% 97.951% ( 15, 22 ] 1467 0.101% 98.052% ( 22, 34 ] 190 0.013% 98.065% ( 34, 51 ] 341 0.023% 98.089% ( 51, 76 ] 344 0.024% 98.113% ( 76, 110 ] 121 0.008% 98.121% ( 110, 170 ] 1189 0.082% 98.203% ( 170, 250 ] 5387 0.371% 98.574% ( 250, 380 ] 6043 0.416% 98.990% ( 380, 580 ] 6479 0.446% 99.436% ( 580, 870 ] 5389 0.371% 99.807% ( 870, 1300 ] 2738 0.188% 99.995% ( 1300, 1900 ] 1164 0.080% 100.075% ( 1900, 2900 ] 1238 0.085% 100.160% ( 2900, 4400 ] 1316 0.091% 100.251% ( 4400, 6600 ] 357 0.025% 100.276% ( 6600, 9900 ] 89 0.006% 100.282% ( 9900, 14000 ] 33 0.002% 100.284% ( 14000, 22000 ] 46 0.003% 100.287% ( 22000, 33000 ] 27 0.002% 100.289% ( 33000, 50000 ] 12 0.001% 100.290% ( 50000, 75000 ] 2 0.000% 100.290% ** Level 5 read latency histogram (micros): Count: 19181 Average: 803.7799 StdDev: 1799.07 Min: 98 Median: 448.7734 Max: 49967 Percentiles: P50: 448.77 P75: 775.50 P99: 5463.20 P99.9: 31800.45 P99.99: 48081.90 ------------------------------------------------------ ( 76, 110 ] 19 0.099% 0.099% ( 110, 170 ] 721 3.759% 3.858% # ( 170, 250 ] 3570 18.612% 22.470% #### ( 250, 380 ] 3904 20.353% 42.824% #### ( 380, 580 ] 4003 20.870% 63.693% #### ( 580, 870 ] 3217 16.772% 80.465% ### ( 870, 1300 ] 1626 8.477% 88.942% ## ( 1300, 1900 ] 614 3.201% 92.143% # ( 1900, 2900 ] 566 2.951% 95.094% # ( 2900, 4400 ] 668 3.483% 98.577% # ( 4400, 6600 ] 168 0.876% 99.453% ( 6600, 9900 ] 39 0.203% 99.656% ( 9900, 14000 ] 10 0.052% 99.708% ( 14000, 22000 ] 19 0.099% 99.807% ( 22000, 33000 ] 20 0.104% 99.911% ( 33000, 50000 ] 17 0.089% 100.000% ** DB Stats ** Uptime(secs): 12.1 total, 4.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 163.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.693 H:M:S, 22.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 199.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.662 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/25-09:59:47 ... thread 0: (1000000,3000000) ops and (264709.2,190645.5) ops/second in (3.777731,15.736010) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 2.81 GB 31.3 2.2 0.0 2.2 5.0 2.8 0.0 1.8 73.9 168.0 30.62 18.37 49 0.625 2299K 12K 0.0 0.0 L1 4/4 316.96 MB 0.0 0.6 0.5 0.2 0.6 0.5 0.0 1.3 67.0 66.2 9.85 3.74 1 9.846 670K 8300 0.0 0.0 L2 1/0 54.09 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 978.22 MB 1.0 2.3 1.7 0.6 2.3 1.7 0.3 1.3 103.9 102.2 22.79 12.43 11 2.072 1895K 13K 0.0 0.0 L4 147/0 9.66 GB 1.0 8.1 2.6 5.6 7.1 1.6 0.2 2.8 142.4 125.0 58.53 37.49 29 2.018 1595K 0 0.0 0.0 L5 154/0 11.57 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 338/19 25.37 GB 0.0 13.3 4.8 8.5 15.1 6.5 3.1 5.3 111.9 126.8 121.79 72.04 90 1.353 6461K 33K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.3 4.8 8.5 15.1 6.5 3.1 5.3 111.9 126.8 121.79 72.04 90 1.353 6461K 33K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.3 4.8 8.5 12.3 3.7 0.0 0.0 126.9 116.9 107.37 63.33 49 2.191 6461K 33K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 200.7 14.41 8.70 41 0.352 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.7 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.08 GB write, 975.74 MB/s write, 13.31 GB read, 860.93 MB/s read, 121.8 seconds Interval compaction: 15.08 GB write, 981.28 MB/s write, 13.31 GB read, 865.82 MB/s read, 121.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 752598 Average: 29.7827 StdDev: 274.81 Min: 0 Median: 1.8205 Max: 43854 Percentiles: P50: 1.82 P75: 2.79 P99: 610.58 P99.9: 2787.89 P99.99: 3996.10 ------------------------------------------------------ [ 0, 1 ] 65376 8.687% 8.687% ## ( 1, 2 ] 378928 50.349% 59.036% ########## ( 2, 3 ] 152359 20.244% 79.280% #### ( 3, 4 ] 50865 6.759% 86.039% # ( 4, 6 ] 50781 6.747% 92.786% # ( 6, 10 ] 13560 1.802% 94.588% ( 10, 15 ] 2798 0.372% 94.960% ( 15, 22 ] 388 0.052% 95.012% ( 22, 34 ] 67 0.009% 95.020% ( 34, 51 ] 32 0.004% 95.025% ( 51, 76 ] 51 0.007% 95.031% ( 76, 110 ] 143 0.019% 95.050% ( 110, 170 ] 5342 0.710% 95.760% ( 170, 250 ] 12970 1.723% 97.484% ( 250, 380 ] 6005 0.798% 98.282% ( 380, 580 ] 5007 0.665% 98.947% ( 580, 870 ] 3812 0.507% 99.453% ( 870, 1300 ] 1984 0.264% 99.717% ( 1300, 1900 ] 749 0.100% 99.817% ( 1900, 2900 ] 710 0.094% 99.911% ( 2900, 4400 ] 818 0.109% 100.020% ( 4400, 6600 ] 173 0.023% 100.043% ( 6600, 9900 ] 39 0.005% 100.048% ( 9900, 14000 ] 18 0.002% 100.050% ( 14000, 22000 ] 28 0.004% 100.054% ( 22000, 33000 ] 10 0.001% 100.055% ( 33000, 50000 ] 7 0.001% 100.056% ** Level 1 read latency histogram (micros): Count: 45868 Average: 33.8102 StdDev: 245.16 Min: 1 Median: 2.6732 Max: 21833 Percentiles: P50: 2.67 P75: 4.40 P99: 559.75 P99.9: 2962.89 P99.99: 11348.53 ------------------------------------------------------ [ 0, 1 ] 181 0.395% 0.395% ( 1, 2 ] 13240 28.865% 29.260% ###### ( 2, 3 ] 14132 30.810% 60.070% ###### ( 3, 4 ] 5493 11.976% 72.046% ## ( 4, 6 ] 6825 14.880% 86.926% ### ( 6, 10 ] 1840 4.012% 90.937% # ( 10, 15 ] 374 0.815% 91.752% ( 15, 22 ] 84 0.183% 91.936% ( 22, 34 ] 4 0.009% 91.944% ( 34, 51 ] 13 0.028% 91.973% ( 51, 76 ] 9 0.020% 91.992% ( 76, 110 ] 28 0.061% 92.053% ( 110, 170 ] 724 1.578% 93.632% ( 170, 250 ] 1653 3.604% 97.236% # ( 250, 380 ] 537 1.171% 98.406% ( 380, 580 ] 303 0.661% 99.067% ( 580, 870 ] 209 0.456% 99.523% ( 870, 1300 ] 104 0.227% 99.749% ( 1300, 1900 ] 31 0.068% 99.817% ( 1900, 2900 ] 37 0.081% 99.898% ( 2900, 4400 ] 27 0.059% 99.956% ( 4400, 6600 ] 11 0.024% 99.980% ( 6600, 9900 ] 3 0.007% 99.987% ( 9900, 14000 ] 4 0.009% 99.996% ( 14000, 22000 ] 2 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 377598 Average: 16.8811 StdDev: 323.67 Min: 1 Median: 2.3264 Max: 43954 Percentiles: P50: 2.33 P75: 3.40 P99: 13.53 P99.9: 1908.37 P99.99: 3142.99 ------------------------------------------------------ [ 0, 1 ] 3473 0.920% 0.920% ( 1, 2 ] 147843 39.154% 40.073% ######## ( 2, 3 ] 114853 30.417% 70.490% ###### ( 3, 4 ] 42887 11.358% 81.848% ## ( 4, 6 ] 49934 13.224% 95.072% ### ( 6, 10 ] 12386 3.280% 98.352% # ( 10, 15 ] 3464 0.917% 99.270% ( 15, 22 ] 573 0.152% 99.421% ( 22, 34 ] 78 0.021% 99.442% ( 34, 51 ] 61 0.016% 99.458% ( 51, 76 ] 59 0.016% 99.474% ( 76, 110 ] 24 0.006% 99.480% ( 110, 170 ] 30 0.008% 99.488% ( 170, 250 ] 40 0.011% 99.499% ( 250, 380 ] 244 0.065% 99.563% ( 380, 580 ] 483 0.128% 99.691% ( 580, 870 ] 376 0.100% 99.791% ( 870, 1300 ] 222 0.059% 99.850% ( 1300, 1900 ] 188 0.050% 99.899% ( 1900, 2900 ] 287 0.076% 99.975% ( 2900, 4400 ] 341 0.090% 100.066% ( 4400, 6600 ] 112 0.030% 100.095% ( 6600, 9900 ] 54 0.014% 100.110% ( 9900, 14000 ] 14 0.004% 100.113% ( 14000, 22000 ] 21 0.006% 100.119% ( 22000, 33000 ] 17 0.005% 100.123% ( 33000, 50000 ] 4 0.001% 100.124% ** Level 3 read latency histogram (micros): Count: 766833 Average: 19.2228 StdDev: 342.52 Min: 1 Median: 2.3427 Max: 51349 Percentiles: P50: 2.34 P75: 3.40 P99: 196.81 P99.9: 1482.02 P99.99: 2805.15 ------------------------------------------------------ [ 0, 1 ] 6974 0.909% 0.909% ( 1, 2 ] 294358 38.386% 39.296% ######## ( 2, 3 ] 239506 31.233% 70.529% ###### ( 3, 4 ] 86612 11.295% 81.824% ## ( 4, 6 ] 98459 12.840% 94.663% ### ( 6, 10 ] 24638 3.213% 97.876% # ( 10, 15 ] 5713 0.745% 98.621% ( 15, 22 ] 765 0.100% 98.721% ( 22, 34 ] 123 0.016% 98.737% ( 34, 51 ] 146 0.019% 98.756% ( 51, 76 ] 136 0.018% 98.774% ( 76, 110 ] 78 0.010% 98.784% ( 110, 170 ] 918 0.120% 98.904% ( 170, 250 ] 2204 0.287% 99.191% ( 250, 380 ] 1317 0.172% 99.363% ( 380, 580 ] 1636 0.213% 99.576% ( 580, 870 ] 1469 0.192% 99.768% ( 870, 1300 ] 891 0.116% 99.884% ( 1300, 1900 ] 406 0.053% 99.937% ( 1900, 2900 ] 450 0.059% 99.996% ( 2900, 4400 ] 651 0.085% 100.080% ( 4400, 6600 ] 166 0.022% 100.102% ( 6600, 9900 ] 69 0.009% 100.111% ( 9900, 14000 ] 33 0.004% 100.115% ( 14000, 22000 ] 76 0.010% 100.125% ( 22000, 33000 ] 48 0.006% 100.132% ( 33000, 50000 ] 3 0.000% 100.132% ( 50000, 75000 ] 1 0.000% 100.132% ** Level 4 read latency histogram (micros): Count: 1481584 Average: 25.2066 StdDev: 278.52 Min: 1 Median: 2.3409 Max: 62335 Percentiles: P50: 2.34 P75: 3.52 P99: 401.18 P99.9: 1079.34 P99.99: 1288.37 ------------------------------------------------------ [ 0, 1 ] 14116 0.953% 0.953% ( 1, 2 ] 579005 39.080% 40.033% ######## ( 2, 3 ] 433131 29.234% 69.267% ###### ( 3, 4 ] 164474 11.101% 80.368% ## ( 4, 6 ] 178664 12.059% 92.427% ## ( 6, 10 ] 44963 3.035% 95.462% # ( 10, 15 ] 10197 0.688% 96.150% ( 15, 22 ] 1473 0.099% 96.250% ( 22, 34 ] 191 0.013% 96.263% ( 34, 51 ] 341 0.023% 96.286% ( 51, 76 ] 344 0.023% 96.309% ( 76, 110 ] 375 0.025% 96.334% ( 110, 170 ] 9346 0.631% 96.965% ( 170, 250 ] 20858 1.408% 98.373% ( 250, 380 ] 8519 0.575% 98.948% ( 380, 580 ] 7282 0.492% 99.439% ( 580, 870 ] 5488 0.370% 99.810% ( 870, 1300 ] 2743 0.185% 99.995% ( 1300, 1900 ] 1167 0.079% 100.074% ( 1900, 2900 ] 1238 0.084% 100.157% ( 2900, 4400 ] 1316 0.089% 100.246% ( 4400, 6600 ] 357 0.024% 100.270% ( 6600, 9900 ] 89 0.006% 100.276% ( 9900, 14000 ] 33 0.002% 100.278% ( 14000, 22000 ] 46 0.003% 100.282% ( 22000, 33000 ] 27 0.002% 100.283% ( 33000, 50000 ] 12 0.001% 100.284% ( 50000, 75000 ] 2 0.000% 100.284% ** Level 5 read latency histogram (micros): Count: 38794 Average: 499.6227 StdDev: 1301.33 Min: 94 Median: 238.8459 Max: 49967 Percentiles: P50: 238.85 P75: 463.61 P99: 4141.90 P99.9: 21244.63 P99.99: 46120.60 ------------------------------------------------------ ( 76, 110 ] 194 0.500% 0.500% ( 110, 170 ] 6661 17.170% 17.670% ### ( 170, 250 ] 14574 37.568% 55.238% ######## ( 250, 380 ] 5766 14.863% 70.101% ### ( 380, 580 ] 4546 11.718% 81.819% ## ( 580, 870 ] 3297 8.499% 90.318% ## ( 870, 1300 ] 1632 4.207% 94.525% # ( 1300, 1900 ] 616 1.588% 96.113% ( 1900, 2900 ] 567 1.462% 97.574% ( 2900, 4400 ] 668 1.722% 99.296% ( 4400, 6600 ] 168 0.433% 99.729% ( 6600, 9900 ] 39 0.101% 99.830% ( 9900, 14000 ] 10 0.026% 99.856% ( 14000, 22000 ] 19 0.049% 99.905% ( 22000, 33000 ] 20 0.052% 99.956% ( 33000, 50000 ] 17 0.044% 100.000% ** DB Stats ** Uptime(secs): 15.8 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 186.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.693 H:M:S, 17.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 260.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 444.404 micros/op 8943 ops/sec 20.238 seconds 180996 operations; 8.7 MB/s (44999 of 44999 found) Microseconds per read: Count: 180996 Average: 444.4281 StdDev: 1274.22 Min: 2 Median: 248.0753 Max: 86120 Percentiles: P50: 248.08 P75: 387.28 P99: 3812.48 P99.9: 20876.30 P99.99: 45912.07 ------------------------------------------------------ ( 1, 2 ] 2 0.001% 0.001% ( 2, 3 ] 7 0.004% 0.005% ( 3, 4 ] 19 0.010% 0.015% ( 4, 6 ] 121 0.067% 0.082% ( 6, 10 ] 350 0.193% 0.276% ( 10, 15 ] 386 0.213% 0.489% ( 15, 22 ] 768 0.424% 0.913% ( 22, 34 ] 4886 2.700% 3.613% # ( 34, 51 ] 3236 1.788% 5.401% ( 51, 76 ] 595 0.329% 5.729% ( 76, 110 ] 97 0.054% 5.783% ( 110, 170 ] 7419 4.099% 9.882% # ( 170, 250 ] 74402 41.107% 50.989% ######## ( 250, 380 ] 42642 23.560% 74.549% ##### ( 380, 580 ] 22449 12.403% 86.952% ## ( 580, 870 ] 11635 6.428% 93.380% # ( 870, 1300 ] 5497 3.037% 96.417% # ( 1300, 1900 ] 2084 1.151% 97.568% ( 1900, 2900 ] 1535 0.848% 98.417% ( 2900, 4400 ] 1736 0.959% 99.376% ( 4400, 6600 ] 515 0.285% 99.660% ( 6600, 9900 ] 228 0.126% 99.786% ( 9900, 14000 ] 102 0.056% 99.843% ( 14000, 22000 ] 121 0.067% 99.909% ( 22000, 33000 ] 114 0.063% 99.972% ( 33000, 50000 ] 42 0.023% 99.996% ( 50000, 75000 ] 5 0.003% 99.998% ( 75000, 110000 ] 3 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2814450 rocksdb.bloom.filter.full.positive COUNT : 207317 rocksdb.bloom.filter.full.true.positive COUNT : 180150 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 846 rocksdb.memtable.miss COUNT : 180150 rocksdb.l0.hit COUNT : 20439 rocksdb.l1.hit COUNT : 2415 rocksdb.l2andup.hit COUNT : 157296 rocksdb.compaction.key.drop.new COUNT : 1105181 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3817156 rocksdb.number.keys.read COUNT : 180996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3939304992 rocksdb.bytes.read COUNT : 180996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 536 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3907307 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 15519266020 rocksdb.compact.write.bytes COUNT : 14379502679 rocksdb.flush.write.bytes COUNT : 3891180745 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 23 rocksdb.number.superversion_acquires COUNT : 730 rocksdb.number.superversion_releases COUNT : 712 rocksdb.number.superversion_cleanups COUNT : 181 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 178 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3865970688 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7153664 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 15961607992 rocksdb.non.last.level.read.count COUNT : 3828434 rocksdb.block.checksum.compute.count COUNT : 3969983 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 247.001533 P95 : 1098.266958 P99 : 3810.934256 P100 : 86118.000000 COUNT : 180996 SUM : 80242231 rocksdb.db.write.micros P50 : 1.647257 P95 : 5.178697 P99 : 8.033978 P100 : 692695.000000 COUNT : 3817156 SUM : 14888229 rocksdb.compaction.times.micros P50 : 2008695.652174 P95 : 4072500.000000 P99 : 9846271.000000 P100 : 9846271.000000 COUNT : 53 SUM : 111200510 rocksdb.compaction.times.cpu_micros P50 : 1238888.888889 P95 : 1857222.222222 P99 : 3558000.000000 P100 : 3744041.000000 COUNT : 53 SUM : 67074349 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 817.272727 P95 : 5115.000000 P99 : 6303.000000 P100 : 6527.000000 COUNT : 54 SUM : 79363 rocksdb.compaction.outfile.sync.micros P50 : 2200.000000 P95 : 8652.187500 P99 : 15520.000000 P100 : 50175.000000 COUNT : 181 SUM : 571010 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 213.636364 P95 : 2166.666667 P99 : 3565.000000 P100 : 3565.000000 COUNT : 124 SUM : 56362 rocksdb.table.open.io.micros P50 : 5710.112360 P95 : 20103.703704 P99 : 26492.000000 P100 : 26492.000000 COUNT : 536 SUM : 3682295 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.444879 P95 : 9.773411 P99 : 210.255714 P100 : 62343.000000 COUNT : 3759771 SUM : 61980601 rocksdb.read.block.get.micros P50 : 211.475243 P95 : 900.228252 P99 : 3360.430108 P100 : 52015.000000 COUNT : 209952 SUM : 71228881 rocksdb.write.raw.block.micros P50 : 0.538128 P95 : 1.447419 P99 : 5.114087 P100 : 69419.000000 COUNT : 4426563 SUM : 16926093 rocksdb.numfiles.in.singlecompaction P50 : 3.159091 P95 : 5.793333 P99 : 11.450000 P100 : 15.000000 COUNT : 71 SUM : 262 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559524 P95 : 1100.013429 P99 : 1266.470009 P100 : 692500.000000 COUNT : 10810 SUM : 3908498 rocksdb.sst.read.micros P50 : 2.196806 P95 : 166.720564 P99 : 543.769490 P100 : 62335.000000 COUNT : 3828879 SUM : 120257110 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 180996 SUM : 180996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3817156 SUM : 3939304992 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 235454.545455 P95 : 819400.000000 P99 : 985309.000000 P100 : 985309.000000 COUNT : 54 SUM : 17154657 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 197 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0