[2024-11-20 14:33:17.134143] Starting SPDK v25.01-pre git sha1 d2ebd983e / DPDK 24.03.0 initialization... [2024-11-20 14:33:17.134317] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3040366 ] Set seed to 1732109597130572 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 14:33:17.279051] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 14:33:17.383994] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 14:33:17.384055] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3040366' to capture a snapshot of events at runtime. [2024-11-20 14:33:17.384068] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 14:33:17.384082] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 14:33:17.384092] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3040366 for offline analysis/debug. [2024-11-20 14:33:17.385351] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 14:33:20 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/20-14:33:27 ... thread 0: (1000000,1000000) ops and (140414.4,140414.4) ops/second in (7.121777,7.121777) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 880.01 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 134.7 6.53 2.82 10 0.653 0 0 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.3 85.9 85.3 3.67 1.61 1 3.667 319K 1978 0.0 0.0 L2 3/2 297.89 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 39/25 1.90 GB 0.7 2.8 1.9 0.9 2.7 1.8 0.0 1.4 105.7 101.7 26.73 14.76 13 2.056 2017K 11K 0.0 0.0 L4 146/12 10.58 GB 1.0 3.3 1.9 1.4 3.2 1.8 0.6 1.7 114.5 109.5 29.90 18.19 15 1.993 783K 0 0.0 0.0 L5 132/0 10.52 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 330/47 24.15 GB 0.0 6.4 4.0 2.4 7.0 4.6 2.4 8.2 98.2 107.5 66.83 37.37 39 1.714 3120K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 4.0 2.4 7.0 4.6 2.4 8.2 98.2 107.5 66.83 37.37 39 1.714 3120K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 4.0 2.4 6.2 3.8 0.0 0.0 108.8 104.6 60.30 34.55 29 2.079 3120K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 134.7 6.53 2.82 10 0.653 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.2 total, 7.1 interval Flush(GB): cumulative 0.859, interval 0.859 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.02 GB write, 997.71 MB/s write, 6.41 GB read, 911.30 MB/s read, 66.8 seconds Interval compaction: 7.02 GB write, 1008.60 MB/s write, 6.41 GB read, 921.25 MB/s read, 66.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 65418 Average: 123.2390 StdDev: 806.52 Min: 1 Median: 2.3048 Max: 43448 Percentiles: P50: 2.30 P75: 3.92 P99: 2599.23 P99.9: 6307.91 P99.99: 37178.94 ------------------------------------------------------ [ 0, 1 ] 1475 2.255% 2.255% ( 1, 2 ] 26423 40.391% 42.646% ######## ( 2, 3 ] 15784 24.128% 66.774% ##### ( 3, 4 ] 5829 8.910% 75.684% ## ( 4, 6 ] 6651 10.167% 85.851% ## ( 6, 10 ] 1702 2.602% 88.453% # ( 10, 15 ] 439 0.671% 89.124% ( 15, 22 ] 73 0.112% 89.235% ( 22, 34 ] 3 0.005% 89.240% ( 34, 51 ] 3 0.005% 89.245% ( 51, 76 ] 3 0.005% 89.249% ( 110, 170 ] 40 0.061% 89.310% ( 170, 250 ] 231 0.353% 89.663% ( 250, 380 ] 902 1.379% 91.042% ( 380, 580 ] 1835 2.805% 93.847% # ( 580, 870 ] 1931 2.952% 96.799% # ( 870, 1300 ] 868 1.327% 98.126% ( 1300, 1900 ] 318 0.486% 98.612% ( 1900, 2900 ] 363 0.555% 99.167% ( 2900, 4400 ] 405 0.619% 99.786% ( 4400, 6600 ] 86 0.131% 99.917% ( 6600, 9900 ] 15 0.023% 99.940% ( 9900, 14000 ] 6 0.009% 99.950% ( 14000, 22000 ] 11 0.017% 99.966% ( 22000, 33000 ] 13 0.020% 99.986% ( 33000, 50000 ] 10 0.015% 100.002% ** Level 1 read latency histogram (micros): Count: 27644 Average: 29.9634 StdDev: 400.33 Min: 1 Median: 2.3904 Max: 35040 Percentiles: P50: 2.39 P75: 3.51 P99: 741.43 P99.9: 3567.80 P99.99: 10865.96 ------------------------------------------------------ [ 0, 1 ] 198 0.716% 0.716% ( 1, 2 ] 10264 37.129% 37.845% ####### ( 2, 3 ] 8606 31.132% 68.977% ###### ( 3, 4 ] 3269 11.825% 80.802% ## ( 4, 6 ] 3551 12.845% 93.648% ### ( 6, 10 ] 877 3.172% 96.820% # ( 10, 15 ] 142 0.514% 97.334% ( 15, 22 ] 22 0.080% 97.414% ( 22, 34 ] 6 0.022% 97.435% ( 34, 51 ] 4 0.014% 97.450% ( 51, 76 ] 4 0.014% 97.464% ( 110, 170 ] 11 0.040% 97.504% ( 170, 250 ] 32 0.116% 97.620% ( 250, 380 ] 91 0.329% 97.949% ( 380, 580 ] 177 0.640% 98.589% ( 580, 870 ] 204 0.738% 99.327% ( 870, 1300 ] 84 0.304% 99.631% ( 1300, 1900 ] 27 0.098% 99.729% ( 1900, 2900 ] 34 0.123% 99.852% ( 2900, 4400 ] 30 0.109% 99.960% ( 4400, 6600 ] 6 0.022% 99.982% ( 6600, 9900 ] 2 0.007% 99.989% ( 9900, 14000 ] 1 0.004% 99.993% ( 22000, 33000 ] 1 0.004% 99.996% ( 33000, 50000 ] 2 0.007% 100.004% ** Level 2 read latency histogram (micros): Count: 390863 Average: 16.1858 StdDev: 292.89 Min: 1 Median: 2.2656 Max: 38593 Percentiles: P50: 2.27 P75: 3.33 P99: 13.41 P99.9: 1894.92 P99.99: 3029.68 ------------------------------------------------------ [ 0, 1 ] 4237 1.084% 1.084% ( 1, 2 ] 161034 41.200% 42.284% ######## ( 2, 3 ] 113553 29.052% 71.335% ###### ( 3, 4 ] 43801 11.206% 82.542% ## ( 4, 6 ] 49830 12.749% 95.290% ### ( 6, 10 ] 12341 3.157% 98.448% # ( 10, 15 ] 3164 0.809% 99.257% ( 15, 22 ] 500 0.128% 99.385% ( 22, 34 ] 94 0.024% 99.409% ( 34, 51 ] 94 0.024% 99.433% ( 51, 76 ] 97 0.025% 99.458% ( 76, 110 ] 27 0.007% 99.465% ( 110, 170 ] 26 0.007% 99.472% ( 170, 250 ] 74 0.019% 99.491% ( 250, 380 ] 234 0.060% 99.550% ( 380, 580 ] 477 0.122% 99.673% ( 580, 870 ] 403 0.103% 99.776% ( 870, 1300 ] 268 0.069% 99.844% ( 1300, 1900 ] 220 0.056% 99.900% ( 1900, 2900 ] 320 0.082% 99.982% ( 2900, 4400 ] 346 0.089% 100.071% ( 4400, 6600 ] 117 0.030% 100.101% ( 6600, 9900 ] 41 0.010% 100.111% ( 9900, 14000 ] 8 0.002% 100.113% ( 14000, 22000 ] 19 0.005% 100.118% ( 22000, 33000 ] 17 0.004% 100.123% ( 33000, 50000 ] 2 0.001% 100.123% ** Level 3 read latency histogram (micros): Count: 713088 Average: 18.5902 StdDev: 349.53 Min: 1 Median: 2.3339 Max: 62682 Percentiles: P50: 2.33 P75: 3.37 P99: 14.52 P99.9: 1225.13 P99.99: 2001.38 ------------------------------------------------------ [ 0, 1 ] 5241 0.735% 0.735% ( 1, 2 ] 276959 38.839% 39.574% ######## ( 2, 3 ] 222680 31.228% 70.802% ###### ( 3, 4 ] 81963 11.494% 82.296% ## ( 4, 6 ] 92539 12.977% 95.273% ### ( 6, 10 ] 22265 3.122% 98.396% # ( 10, 15 ] 4765 0.668% 99.064% ( 15, 22 ] 618 0.087% 99.150% ( 22, 34 ] 119 0.017% 99.167% ( 34, 51 ] 210 0.029% 99.197% ( 51, 76 ] 163 0.023% 99.219% ( 76, 110 ] 45 0.006% 99.226% ( 110, 170 ] 86 0.012% 99.238% ( 170, 250 ] 245 0.034% 99.272% ( 250, 380 ] 739 0.104% 99.376% ( 380, 580 ] 1503 0.211% 99.587% ( 580, 870 ] 1543 0.216% 99.803% ( 870, 1300 ] 839 0.118% 99.921% ( 1300, 1900 ] 445 0.062% 99.983% ( 1900, 2900 ] 500 0.070% 100.053% ( 2900, 4400 ] 623 0.087% 100.141% ( 4400, 6600 ] 170 0.024% 100.164% ( 6600, 9900 ] 59 0.008% 100.173% ( 9900, 14000 ] 27 0.004% 100.176% ( 14000, 22000 ] 47 0.007% 100.183% ( 22000, 33000 ] 34 0.005% 100.188% ( 33000, 50000 ] 13 0.002% 100.190% ( 50000, 75000 ] 1 0.000% 100.190% ** Level 4 read latency histogram (micros): Count: 512643 Average: 34.3691 StdDev: 472.09 Min: 1 Median: 2.3433 Max: 51429 Percentiles: P50: 2.34 P75: 3.44 P99: 655.34 P99.9: 2289.52 P99.99: 3007.30 ------------------------------------------------------ [ 0, 1 ] 4969 0.969% 0.969% ( 1, 2 ] 197985 38.620% 39.590% ######## ( 2, 3 ] 155441 30.321% 69.911% ###### ( 3, 4 ] 58798 11.470% 81.381% ## ( 4, 6 ] 65199 12.718% 94.099% ### ( 6, 10 ] 15548 3.033% 97.132% # ( 10, 15 ] 3209 0.626% 97.758% ( 15, 22 ] 369 0.072% 97.830% ( 22, 34 ] 75 0.015% 97.845% ( 34, 51 ] 147 0.029% 97.873% ( 51, 76 ] 112 0.022% 97.895% ( 76, 110 ] 30 0.006% 97.901% ( 110, 170 ] 122 0.024% 97.925% ( 170, 250 ] 490 0.096% 98.020% ( 250, 380 ] 1433 0.280% 98.300% ( 380, 580 ] 2814 0.549% 98.849% ( 580, 870 ] 2993 0.584% 99.433% ( 870, 1300 ] 1489 0.290% 99.723% ( 1300, 1900 ] 655 0.128% 99.851% ( 1900, 2900 ] 653 0.127% 99.978% ( 2900, 4400 ] 877 0.171% 100.149% ( 4400, 6600 ] 248 0.048% 100.198% ( 6600, 9900 ] 59 0.012% 100.209% ( 9900, 14000 ] 25 0.005% 100.214% ( 14000, 22000 ] 53 0.010% 100.224% ( 22000, 33000 ] 31 0.006% 100.230% ( 33000, 50000 ] 23 0.004% 100.235% ( 50000, 75000 ] 2 0.000% 100.235% ** Level 5 read latency histogram (micros): Count: 7807 Average: 1212.7998 StdDev: 2355.30 Min: 100 Median: 674.0965 Max: 48981 Percentiles: P50: 674.10 P75: 1145.22 P99: 6462.40 P99.9: 39790.85 P99.99: 48979.08 ------------------------------------------------------ ( 76, 110 ] 2 0.026% 0.026% ( 110, 170 ] 86 1.102% 1.127% ( 170, 250 ] 324 4.150% 5.277% # ( 250, 380 ] 899 11.515% 16.793% ## ( 380, 580 ] 1964 25.157% 41.950% ##### ( 580, 870 ] 1937 24.811% 66.761% ##### ( 870, 1300 ] 1005 12.873% 79.634% ### ( 1300, 1900 ] 409 5.239% 84.873% # ( 1900, 2900 ] 398 5.098% 89.971% # ( 2900, 4400 ] 554 7.096% 97.067% # ( 4400, 6600 ] 161 2.062% 99.129% ( 6600, 9900 ] 26 0.333% 99.462% ( 9900, 14000 ] 3 0.038% 99.500% ( 14000, 22000 ] 9 0.115% 99.616% ( 22000, 33000 ] 17 0.218% 99.833% ( 33000, 50000 ] 13 0.167% 100.000% ** DB Stats ** Uptime(secs): 7.2 total, 7.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 136.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.173 H:M:S, 30.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 138.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.173 H:M:S, 30.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/11/20-14:33:31 ... thread 0: (1000000,2000000) ops and (256066.9,181372.9) ops/second in (3.905229,11.027006) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 1.84 GB 125.2 1.1 0.0 1.1 2.9 1.8 0.0 1.6 60.0 159.6 18.87 10.42 30 0.629 1149K 6203 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.3 85.9 85.3 3.67 1.61 1 3.667 319K 1978 0.0 0.0 L2 2/1 190.00 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 37/21 1.80 GB 0.8 2.9 2.0 0.9 2.8 1.9 0.0 1.4 107.0 103.2 27.40 15.30 14 1.957 2127K 11K 0.0 0.0 L4 138/0 9.66 GB 1.0 4.5 2.1 2.4 4.2 1.8 0.6 2.0 127.9 118.0 36.30 22.99 19 1.910 997K 0 0.0 0.0 L5 144/0 11.44 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 335/30 24.92 GB 0.0 8.8 4.3 4.5 10.2 5.7 3.4 5.5 104.6 121.0 86.24 50.32 64 1.347 4594K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.8 4.3 4.5 10.2 5.7 3.4 5.5 104.6 121.0 86.24 50.32 64 1.347 4594K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.8 4.3 4.5 8.3 3.9 0.0 0.0 118.5 112.3 76.10 44.54 38 2.003 4594K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 186.1 10.14 5.78 26 0.390 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.1 total, 11.0 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.19 GB write, 939.36 MB/s write, 8.81 GB read, 812.25 MB/s read, 86.2 seconds Interval compaction: 10.19 GB write, 945.99 MB/s write, 8.81 GB read, 817.98 MB/s read, 86.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 427235 Average: 33.8940 StdDev: 330.44 Min: 1 Median: 1.7649 Max: 43448 Percentiles: P50: 1.76 P75: 2.63 P99: 659.15 P99.9: 2537.83 P99.99: 3611.77 ------------------------------------------------------ [ 0, 1 ] 31533 7.381% 7.381% # ( 1, 2 ] 238044 55.717% 63.098% ########### ( 2, 3 ] 80683 18.885% 81.983% #### ( 3, 4 ] 24325 5.694% 87.677% # ( 4, 6 ] 20279 4.747% 92.423% # ( 6, 10 ] 6323 1.480% 93.903% ( 10, 15 ] 1255 0.294% 94.197% ( 15, 22 ] 176 0.041% 94.238% ( 22, 34 ] 19 0.004% 94.243% ( 34, 51 ] 14 0.003% 94.246% ( 51, 76 ] 8 0.002% 94.248% ( 76, 110 ] 69 0.016% 94.264% ( 110, 170 ] 2543 0.595% 94.859% ( 170, 250 ] 8122 1.901% 96.760% ( 250, 380 ] 4994 1.169% 97.929% ( 380, 580 ] 3800 0.889% 98.818% ( 580, 870 ] 2853 0.668% 99.486% ( 870, 1300 ] 1120 0.262% 99.748% ( 1300, 1900 ] 358 0.084% 99.832% ( 1900, 2900 ] 459 0.107% 99.940% ( 2900, 4400 ] 460 0.108% 100.047% ( 4400, 6600 ] 91 0.021% 100.069% ( 6600, 9900 ] 18 0.004% 100.073% ( 9900, 14000 ] 6 0.001% 100.074% ( 14000, 22000 ] 11 0.003% 100.077% ( 22000, 33000 ] 13 0.003% 100.080% ( 33000, 50000 ] 10 0.002% 100.082% ** Level 1 read latency histogram (micros): Count: 61612 Average: 18.9097 StdDev: 272.03 Min: 1 Median: 2.2473 Max: 35040 Percentiles: P50: 2.25 P75: 3.23 P99: 442.03 P99.9: 2397.13 P99.99: 6174.23 ------------------------------------------------------ [ 0, 1 ] 983 1.595% 1.595% ( 1, 2 ] 25237 40.961% 42.557% ######## ( 2, 3 ] 18543 30.096% 72.653% ###### ( 3, 4 ] 6319 10.256% 82.909% ## ( 4, 6 ] 6847 11.113% 94.022% ## ( 6, 10 ] 1832 2.973% 96.996% # ( 10, 15 ] 288 0.467% 97.463% ( 15, 22 ] 37 0.060% 97.523% ( 22, 34 ] 6 0.010% 97.533% ( 34, 51 ] 4 0.006% 97.539% ( 51, 76 ] 4 0.006% 97.546% ( 76, 110 ] 1 0.002% 97.548% ( 110, 170 ] 142 0.230% 97.778% ( 170, 250 ] 395 0.641% 98.419% ( 250, 380 ] 276 0.448% 98.867% ( 380, 580 ] 264 0.428% 99.296% ( 580, 870 ] 235 0.381% 99.677% ( 870, 1300 ] 87 0.141% 99.818% ( 1300, 1900 ] 31 0.050% 99.869% ( 1900, 2900 ] 39 0.063% 99.932% ( 2900, 4400 ] 31 0.050% 99.982% ( 4400, 6600 ] 6 0.010% 99.992% ( 6600, 9900 ] 2 0.003% 99.995% ( 9900, 14000 ] 1 0.002% 99.997% ( 22000, 33000 ] 1 0.002% 99.998% ( 33000, 50000 ] 2 0.003% 100.002% ** Level 2 read latency histogram (micros): Count: 390863 Average: 16.1858 StdDev: 292.89 Min: 1 Median: 2.2656 Max: 38593 Percentiles: P50: 2.27 P75: 3.33 P99: 13.41 P99.9: 1894.92 P99.99: 3029.68 ------------------------------------------------------ [ 0, 1 ] 4237 1.084% 1.084% ( 1, 2 ] 161034 41.200% 42.284% ######## ( 2, 3 ] 113553 29.052% 71.335% ###### ( 3, 4 ] 43801 11.206% 82.542% ## ( 4, 6 ] 49830 12.749% 95.290% ### ( 6, 10 ] 12341 3.157% 98.448% # ( 10, 15 ] 3164 0.809% 99.257% ( 15, 22 ] 500 0.128% 99.385% ( 22, 34 ] 94 0.024% 99.409% ( 34, 51 ] 94 0.024% 99.433% ( 51, 76 ] 97 0.025% 99.458% ( 76, 110 ] 27 0.007% 99.465% ( 110, 170 ] 26 0.007% 99.472% ( 170, 250 ] 74 0.019% 99.491% ( 250, 380 ] 234 0.060% 99.550% ( 380, 580 ] 477 0.122% 99.673% ( 580, 870 ] 403 0.103% 99.776% ( 870, 1300 ] 268 0.069% 99.844% ( 1300, 1900 ] 220 0.056% 99.900% ( 1900, 2900 ] 320 0.082% 99.982% ( 2900, 4400 ] 346 0.089% 100.071% ( 4400, 6600 ] 117 0.030% 100.101% ( 6600, 9900 ] 41 0.010% 100.111% ( 9900, 14000 ] 8 0.002% 100.113% ( 14000, 22000 ] 19 0.005% 100.118% ( 22000, 33000 ] 17 0.004% 100.123% ( 33000, 50000 ] 2 0.001% 100.123% ** Level 3 read latency histogram (micros): Count: 925763 Average: 16.7658 StdDev: 308.56 Min: 1 Median: 2.2267 Max: 62682 Percentiles: P50: 2.23 P75: 3.16 P99: 195.98 P99.9: 1133.66 P99.99: 1951.94 ------------------------------------------------------ [ 0, 1 ] 10439 1.128% 1.128% ( 1, 2 ] 389212 42.042% 43.170% ######## ( 2, 3 ] 278898 30.126% 73.296% ###### ( 3, 4 ] 96648 10.440% 83.736% ## ( 4, 6 ] 105499 11.396% 95.132% ## ( 6, 10 ] 27008 2.917% 98.049% # ( 10, 15 ] 5555 0.600% 98.649% ( 15, 22 ] 698 0.075% 98.725% ( 22, 34 ] 131 0.014% 98.739% ( 34, 51 ] 234 0.025% 98.764% ( 51, 76 ] 171 0.018% 98.783% ( 76, 110 ] 79 0.009% 98.791% ( 110, 170 ] 971 0.105% 98.896% ( 170, 250 ] 2966 0.320% 99.216% ( 250, 380 ] 1933 0.209% 99.425% ( 380, 580 ] 2085 0.225% 99.650% ( 580, 870 ] 1760 0.190% 99.841% ( 870, 1300 ] 899 0.097% 99.938% ( 1300, 1900 ] 458 0.049% 99.987% ( 1900, 2900 ] 528 0.057% 100.044% ( 2900, 4400 ] 635 0.069% 100.113% ( 4400, 6600 ] 171 0.018% 100.131% ( 6600, 9900 ] 61 0.007% 100.138% ( 9900, 14000 ] 27 0.003% 100.141% ( 14000, 22000 ] 47 0.005% 100.146% ( 22000, 33000 ] 34 0.004% 100.149% ( 33000, 50000 ] 13 0.001% 100.151% ( 50000, 75000 ] 1 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 656072 Average: 37.1083 StdDev: 423.37 Min: 1 Median: 2.3652 Max: 51429 Percentiles: P50: 2.37 P75: 3.59 P99: 606.56 P99.9: 1914.69 P99.99: 2708.32 ------------------------------------------------------ [ 0, 1 ] 6125 0.934% 0.934% ( 1, 2 ] 251923 38.399% 39.332% ######## ( 2, 3 ] 191627 29.208% 68.540% ###### ( 3, 4 ] 72160 10.999% 79.539% ## ( 4, 6 ] 78166 11.914% 91.454% ## ( 6, 10 ] 18848 2.873% 94.326% # ( 10, 15 ] 3843 0.586% 94.912% ( 15, 22 ] 441 0.067% 94.979% ( 22, 34 ] 87 0.013% 94.993% ( 34, 51 ] 178 0.027% 95.020% ( 51, 76 ] 117 0.018% 95.038% ( 76, 110 ] 151 0.023% 95.061% ( 110, 170 ] 3611 0.550% 95.611% ( 170, 250 ] 10764 1.641% 97.252% ( 250, 380 ] 6186 0.943% 98.195% ( 380, 580 ] 4931 0.752% 98.946% ( 580, 870 ] 3858 0.588% 99.534% ( 870, 1300 ] 1680 0.256% 99.790% ( 1300, 1900 ] 709 0.108% 99.898% ( 1900, 2900 ] 744 0.113% 100.012% ( 2900, 4400 ] 921 0.140% 100.152% ( 4400, 6600 ] 251 0.038% 100.190% ( 6600, 9900 ] 63 0.010% 100.200% ( 9900, 14000 ] 26 0.004% 100.204% ( 14000, 22000 ] 53 0.008% 100.212% ( 22000, 33000 ] 31 0.005% 100.217% ( 33000, 50000 ] 23 0.004% 100.220% ( 50000, 75000 ] 2 0.000% 100.221% ** Level 5 read latency histogram (micros): Count: 23344 Average: 593.7241 StdDev: 1447.71 Min: 91 Median: 291.2594 Max: 48981 Percentiles: P50: 291.27 P75: 550.01 P99: 4398.85 P99.9: 26306.18 P99.99: 46947.19 ------------------------------------------------------ ( 76, 110 ] 76 0.326% 0.326% ( 110, 170 ] 2629 11.262% 11.588% ## ( 170, 250 ] 7654 32.788% 44.375% ####### ( 250, 380 ] 4138 17.726% 62.102% #### ( 380, 580 ] 3543 15.177% 77.279% ### ( 580, 870 ] 2485 10.645% 87.924% ## ( 870, 1300 ] 1118 4.789% 92.713% # ( 1300, 1900 ] 437 1.872% 94.585% ( 1900, 2900 ] 446 1.911% 96.496% ( 2900, 4400 ] 586 2.510% 99.006% # ( 4400, 6600 ] 163 0.698% 99.704% ( 6600, 9900 ] 27 0.116% 99.820% ( 9900, 14000 ] 4 0.017% 99.837% ( 14000, 22000 ] 9 0.039% 99.876% ( 22000, 33000 ] 17 0.073% 99.949% ( 33000, 50000 ] 13 0.056% 100.004% ** DB Stats ** Uptime(secs): 11.1 total, 3.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 177.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.173 H:M:S, 19.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 252.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-14:33:35 ... thread 0: (1000000,3000000) ops and (257272.6,201154.2) ops/second in (3.886928,14.913934) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 2.75 GB 12.6 2.2 0.0 2.2 5.0 2.8 0.0 1.8 73.0 163.8 31.03 18.04 49 0.633 2299K 12K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.3 85.9 85.3 3.67 1.61 1 3.667 319K 1978 0.0 0.0 L2 1/1 128.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 25/14 1.23 GB 0.6 4.0 2.0 1.9 3.9 1.9 0.0 1.9 121.9 118.3 33.39 20.52 15 2.226 3282K 24K 0.0 0.0 L4 140/0 9.56 GB 1.0 5.3 2.3 3.0 4.8 1.8 1.0 2.1 137.0 124.4 39.69 26.15 22 1.804 1164K 0 0.0 0.0 L5 153/0 12.02 GB 0.1 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/30 25.69 GB 0.0 11.8 4.6 7.2 13.9 6.7 4.4 5.0 112.1 132.5 107.78 66.31 87 1.239 7065K 38K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.8 4.6 7.2 13.9 6.7 4.4 5.0 112.1 132.5 107.78 66.31 87 1.239 7065K 38K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.8 4.6 7.2 11.2 3.9 0.0 0.0 127.9 121.3 94.47 57.82 46 2.054 7065K 38K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 212.6 13.31 8.49 41 0.325 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.9 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.95 GB write, 952.71 MB/s write, 11.80 GB read, 806.01 MB/s read, 107.8 seconds Interval compaction: 13.95 GB write, 957.67 MB/s write, 11.80 GB read, 810.22 MB/s read, 107.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 23, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 709306 Average: 26.1902 StdDev: 261.23 Min: 1 Median: 1.7489 Max: 43448 Percentiles: P50: 1.75 P75: 2.58 P99: 501.25 P99.9: 1763.66 P99.99: 3076.88 ------------------------------------------------------ [ 0, 1 ] 54466 7.679% 7.679% ## ( 1, 2 ] 400846 56.512% 64.191% ########### ( 2, 3 ] 132241 18.644% 82.835% #### ( 3, 4 ] 39741 5.603% 88.438% # ( 4, 6 ] 32505 4.583% 93.020% # ( 6, 10 ] 9229 1.301% 94.321% ( 10, 15 ] 1834 0.259% 94.580% ( 15, 22 ] 249 0.035% 94.615% ( 22, 34 ] 35 0.005% 94.620% ( 34, 51 ] 17 0.002% 94.622% ( 51, 76 ] 8 0.001% 94.624% ( 76, 110 ] 171 0.024% 94.648% ( 110, 170 ] 5264 0.742% 95.390% ( 170, 250 ] 15085 2.127% 97.517% ( 250, 380 ] 7623 1.075% 98.591% ( 380, 580 ] 4785 0.675% 99.266% ( 580, 870 ] 3056 0.431% 99.697% ( 870, 1300 ] 1157 0.163% 99.860% ( 1300, 1900 ] 371 0.052% 99.912% ( 1900, 2900 ] 499 0.070% 99.983% ( 2900, 4400 ] 467 0.066% 100.048% ( 4400, 6600 ] 91 0.013% 100.061% ( 6600, 9900 ] 19 0.003% 100.064% ( 9900, 14000 ] 9 0.001% 100.065% ( 14000, 22000 ] 11 0.002% 100.067% ( 22000, 33000 ] 13 0.002% 100.069% ( 33000, 50000 ] 10 0.001% 100.070% ** Level 1 read latency histogram (micros): Count: 73372 Average: 20.3938 StdDev: 258.30 Min: 1 Median: 2.1786 Max: 35040 Percentiles: P50: 2.18 P75: 3.12 P99: 430.85 P99.9: 2269.51 P99.99: 6476.36 ------------------------------------------------------ [ 0, 1 ] 1659 2.261% 2.261% ( 1, 2 ] 31218 42.548% 44.809% ######### ( 2, 3 ] 21323 29.061% 73.870% ###### ( 3, 4 ] 6891 9.392% 83.262% ## ( 4, 6 ] 7253 9.885% 93.147% ## ( 6, 10 ] 2040 2.780% 95.928% # ( 10, 15 ] 329 0.448% 96.376% ( 15, 22 ] 41 0.056% 96.432% ( 22, 34 ] 7 0.010% 96.441% ( 34, 51 ] 4 0.005% 96.447% ( 51, 76 ] 4 0.005% 96.452% ( 76, 110 ] 6 0.008% 96.461% ( 110, 170 ] 361 0.492% 96.953% ( 170, 250 ] 926 1.262% 98.215% ( 250, 380 ] 485 0.661% 98.876% ( 380, 580 ] 359 0.489% 99.365% ( 580, 870 ] 256 0.349% 99.714% ( 870, 1300 ] 89 0.121% 99.835% ( 1300, 1900 ] 31 0.042% 99.877% ( 1900, 2900 ] 45 0.061% 99.939% ( 2900, 4400 ] 32 0.044% 99.982% ( 4400, 6600 ] 6 0.008% 99.990% ( 6600, 9900 ] 3 0.004% 99.995% ( 9900, 14000 ] 2 0.003% 99.997% ( 22000, 33000 ] 1 0.001% 99.999% ( 33000, 50000 ] 2 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 390863 Average: 16.1858 StdDev: 292.89 Min: 1 Median: 2.2656 Max: 38593 Percentiles: P50: 2.27 P75: 3.33 P99: 13.41 P99.9: 1894.92 P99.99: 3029.68 ------------------------------------------------------ [ 0, 1 ] 4237 1.084% 1.084% ( 1, 2 ] 161034 41.200% 42.284% ######## ( 2, 3 ] 113553 29.052% 71.335% ###### ( 3, 4 ] 43801 11.206% 82.542% ## ( 4, 6 ] 49830 12.749% 95.290% ### ( 6, 10 ] 12341 3.157% 98.448% # ( 10, 15 ] 3164 0.809% 99.257% ( 15, 22 ] 500 0.128% 99.385% ( 22, 34 ] 94 0.024% 99.409% ( 34, 51 ] 94 0.024% 99.433% ( 51, 76 ] 97 0.025% 99.458% ( 76, 110 ] 27 0.007% 99.465% ( 110, 170 ] 26 0.007% 99.472% ( 170, 250 ] 74 0.019% 99.491% ( 250, 380 ] 234 0.060% 99.550% ( 380, 580 ] 477 0.122% 99.673% ( 580, 870 ] 403 0.103% 99.776% ( 870, 1300 ] 268 0.069% 99.844% ( 1300, 1900 ] 220 0.056% 99.900% ( 1900, 2900 ] 320 0.082% 99.982% ( 2900, 4400 ] 346 0.089% 100.071% ( 4400, 6600 ] 117 0.030% 100.101% ( 6600, 9900 ] 41 0.010% 100.111% ( 9900, 14000 ] 8 0.002% 100.113% ( 14000, 22000 ] 19 0.005% 100.118% ( 22000, 33000 ] 17 0.004% 100.123% ( 33000, 50000 ] 2 0.001% 100.123% ** Level 3 read latency histogram (micros): Count: 1145012 Average: 15.3545 StdDev: 278.80 Min: 1 Median: 2.1634 Max: 62682 Percentiles: P50: 2.16 P75: 3.01 P99: 213.86 P99.9: 1025.81 P99.99: 1868.66 ------------------------------------------------------ [ 0, 1 ] 16122 1.408% 1.408% ( 1, 2 ] 500784 43.736% 45.144% ######### ( 2, 3 ] 340293 29.720% 74.864% ###### ( 3, 4 ] 112127 9.793% 84.656% ## ( 4, 6 ] 119753 10.459% 95.115% ## ( 6, 10 ] 31518 2.753% 97.868% # ( 10, 15 ] 6318 0.552% 98.419% ( 15, 22 ] 794 0.069% 98.489% ( 22, 34 ] 143 0.012% 98.501% ( 34, 51 ] 242 0.021% 98.522% ( 51, 76 ] 174 0.015% 98.538% ( 76, 110 ] 117 0.010% 98.548% ( 110, 170 ] 2044 0.179% 98.726% ( 170, 250 ] 5716 0.499% 99.226% ( 250, 380 ] 2999 0.262% 99.488% ( 380, 580 ] 2523 0.220% 99.708% ( 580, 870 ] 1868 0.163% 99.871% ( 870, 1300 ] 919 0.080% 99.951% ( 1300, 1900 ] 469 0.041% 99.992% ( 1900, 2900 ] 550 0.048% 100.040% ( 2900, 4400 ] 643 0.056% 100.096% ( 4400, 6600 ] 171 0.015% 100.111% ( 6600, 9900 ] 62 0.005% 100.117% ( 9900, 14000 ] 28 0.002% 100.119% ( 14000, 22000 ] 47 0.004% 100.123% ( 22000, 33000 ] 34 0.003% 100.126% ( 33000, 50000 ] 13 0.001% 100.127% ( 50000, 75000 ] 1 0.000% 100.128% ** Level 4 read latency histogram (micros): Count: 837759 Average: 36.6988 StdDev: 380.14 Min: 1 Median: 2.3385 Max: 51429 Percentiles: P50: 2.34 P75: 3.61 P99: 550.76 P99.9: 1711.74 P99.99: 2502.11 ------------------------------------------------------ [ 0, 1 ] 8866 1.058% 1.058% ( 1, 2 ] 329865 39.375% 40.433% ######## ( 2, 3 ] 236748 28.260% 68.693% ###### ( 3, 4 ] 86548 10.331% 79.024% ## ( 4, 6 ] 92568 11.049% 90.073% ## ( 6, 10 ] 23106 2.758% 92.831% # ( 10, 15 ] 4677 0.558% 93.389% ( 15, 22 ] 547 0.065% 93.455% ( 22, 34 ] 90 0.011% 93.465% ( 34, 51 ] 189 0.023% 93.488% ( 51, 76 ] 119 0.014% 93.502% ( 76, 110 ] 326 0.039% 93.541% ( 110, 170 ] 7774 0.928% 94.469% ( 170, 250 ] 21467 2.562% 97.031% # ( 250, 380 ] 10724 1.280% 98.312% ( 380, 580 ] 6755 0.806% 99.118% ( 580, 870 ] 4282 0.511% 99.629% ( 870, 1300 ] 1759 0.210% 99.839% ( 1300, 1900 ] 745 0.089% 99.928% ( 1900, 2900 ] 864 0.103% 100.031% ( 2900, 4400 ] 949 0.113% 100.144% ( 4400, 6600 ] 252 0.030% 100.174% ( 6600, 9900 ] 65 0.008% 100.182% ( 9900, 14000 ] 31 0.004% 100.186% ( 14000, 22000 ] 53 0.006% 100.192% ( 22000, 33000 ] 31 0.004% 100.196% ( 33000, 50000 ] 23 0.003% 100.199% ( 50000, 75000 ] 2 0.000% 100.199% ** Level 5 read latency histogram (micros): Count: 38941 Average: 463.8322 StdDev: 1149.41 Min: 91 Median: 241.3677 Max: 48981 Percentiles: P50: 241.37 P75: 417.14 P99: 4030.17 P99.9: 14052.44 P99.99: 44907.72 ------------------------------------------------------ ( 76, 110 ] 193 0.496% 0.496% ( 110, 170 ] 5574 14.314% 14.810% ### ( 170, 250 ] 15361 39.447% 54.256% ######## ( 250, 380 ] 7182 18.443% 72.700% #### ( 380, 580 ] 4823 12.385% 85.085% ## ( 580, 870 ] 2782 7.144% 92.229% # ( 870, 1300 ] 1169 3.002% 95.231% # ( 1300, 1900 ] 474 1.217% 96.448% ( 1900, 2900 ] 537 1.379% 97.827% ( 2900, 4400 ] 606 1.556% 99.384% ( 4400, 6600 ] 165 0.424% 99.807% ( 6600, 9900 ] 29 0.074% 99.882% ( 9900, 14000 ] 7 0.018% 99.900% ( 14000, 22000 ] 9 0.023% 99.923% ( 22000, 33000 ] 17 0.044% 99.967% ( 33000, 50000 ] 13 0.033% 100.000% ** DB Stats ** Uptime(secs): 15.0 total, 3.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 196.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.173 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 450.443 micros/op 8841 ops/sec 20.245 seconds 178996 operations; 8.6 MB/s (44999 of 44999 found) Microseconds per read: Count: 178996 Average: 450.4629 StdDev: 1268.64 Min: 2 Median: 269.3433 Max: 97689 Percentiles: P50: 269.34 P75: 431.51 P99: 3663.21 P99.9: 19884.56 P99.99: 48208.29 ------------------------------------------------------ ( 1, 2 ] 6 0.003% 0.003% ( 2, 3 ] 31 0.017% 0.021% ( 3, 4 ] 65 0.036% 0.057% ( 4, 6 ] 163 0.091% 0.148% ( 6, 10 ] 323 0.180% 0.328% ( 10, 15 ] 657 0.367% 0.696% ( 15, 22 ] 2318 1.295% 1.991% ( 22, 34 ] 2720 1.520% 3.510% ( 34, 51 ] 1450 0.810% 4.320% ( 51, 76 ] 217 0.121% 4.441% ( 76, 110 ] 55 0.031% 4.472% ( 110, 170 ] 9812 5.482% 9.954% # ( 170, 250 ] 65051 36.342% 46.296% ####### ( 250, 380 ] 44558 24.893% 71.189% ##### ( 380, 580 ] 26486 14.797% 85.986% ### ( 580, 870 ] 13792 7.705% 93.691% ## ( 870, 1300 ] 5268 2.943% 96.635% # ( 1300, 1900 ] 1831 1.023% 97.657% ( 1900, 2900 ] 1563 0.873% 98.531% ( 2900, 4400 ] 1651 0.922% 99.453% ( 4400, 6600 ] 441 0.246% 99.699% ( 6600, 9900 ] 155 0.087% 99.786% ( 9900, 14000 ] 115 0.064% 99.850% ( 14000, 22000 ] 121 0.068% 99.918% ( 22000, 33000 ] 96 0.054% 99.972% ( 33000, 50000 ] 37 0.021% 99.992% ( 50000, 75000 ] 12 0.007% 99.999% ( 75000, 110000 ] 2 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2680040 rocksdb.bloom.filter.full.positive COUNT : 203997 rocksdb.bloom.filter.full.true.positive COUNT : 178135 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 861 rocksdb.memtable.miss COUNT : 178135 rocksdb.l0.hit COUNT : 19609 rocksdb.l1.hit COUNT : 80 rocksdb.l2andup.hit COUNT : 158446 rocksdb.compaction.key.drop.new COUNT : 981009 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3967279 rocksdb.number.keys.read COUNT : 178996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4094231928 rocksdb.bytes.read COUNT : 178996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 562 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3535263 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16826175718 rocksdb.compact.write.bytes COUNT : 15813632212 rocksdb.flush.write.bytes COUNT : 4023385100 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 31 rocksdb.number.superversion_acquires COUNT : 785 rocksdb.number.superversion_releases COUNT : 763 rocksdb.number.superversion_cleanups COUNT : 197 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 162 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3997034496 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7129088 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 17188195404 rocksdb.non.last.level.read.count COUNT : 4125197 rocksdb.block.checksum.compute.count COUNT : 4282982 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 267.482341 P95 : 1059.953524 P99 : 3662.748184 P100 : 97688.000000 COUNT : 178996 SUM : 80471520 rocksdb.db.write.micros P50 : 1.636152 P95 : 5.199468 P99 : 7.861714 P100 : 575813.000000 COUNT : 3967279 SUM : 14880525 rocksdb.compaction.times.micros P50 : 1666666.666667 P95 : 4905000.000000 P99 : 5983162.000000 P100 : 5983162.000000 COUNT : 58 SUM : 113160772 rocksdb.compaction.times.cpu_micros P50 : 1123225.806452 P95 : 1868500.000000 P99 : 5221069.000000 P100 : 5221069.000000 COUNT : 58 SUM : 73723425 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 861.470588 P95 : 6765.000000 P99 : 9175.000000 P100 : 9175.000000 COUNT : 57 SUM : 88014 rocksdb.compaction.outfile.sync.micros P50 : 1704.347826 P95 : 7983.461538 P99 : 13549.000000 P100 : 81052.000000 COUNT : 211 SUM : 674634 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 210.000000 P95 : 1645.000000 P99 : 4215.000000 P100 : 6249.000000 COUNT : 137 SUM : 60753 rocksdb.table.open.io.micros P50 : 5292.753623 P95 : 18071.111111 P99 : 22696.666667 P100 : 32377.000000 COUNT : 562 SUM : 3472524 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.430597 P95 : 9.674809 P99 : 211.129262 P100 : 49728.000000 COUNT : 4075742 SUM : 61167601 rocksdb.read.block.get.micros P50 : 223.171307 P95 : 854.280866 P99 : 3257.743435 P100 : 62686.000000 COUNT : 206703 SUM : 72977787 rocksdb.write.raw.block.micros P50 : 0.534231 P95 : 1.352856 P99 : 4.586555 P100 : 89749.000000 COUNT : 4805675 SUM : 17097504 rocksdb.numfiles.in.singlecompaction P50 : 3.125000 P95 : 5.266667 P99 : 16.260000 P100 : 22.000000 COUNT : 82 SUM : 308 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.555393 P95 : 1095.529044 P99 : 1282.776944 P100 : 575631.000000 COUNT : 12182 SUM : 3536342 rocksdb.sst.read.micros P50 : 2.107736 P95 : 165.545433 P99 : 510.495984 P100 : 62682.000000 COUNT : 4125075 SUM : 120235030 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 178996 SUM : 178996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3967279 SUM : 4094231928 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 224285.714286 P95 : 877000.000000 P99 : 907301.000000 P100 : 907301.000000 COUNT : 57 SUM : 17042948 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 227 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0