[2024-07-15 13:33:22.610291] Starting SPDK v24.09-pre git sha1 9cede6267 / DPDK 24.03.0 initialization... [2024-07-15 13:33:22.610421] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1486126 ] Set seed to 1721043202607581 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 13:33:22.743897] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 13:33:22.969267] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 13:33:22.969320] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1486126' to capture a snapshot of events at runtime. [2024-07-15 13:33:22.969333] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 13:33:22.969346] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 13:33:22.969356] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1486126 for offline analysis/debug. [2024-07-15 13:33:22.969460] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 13:33:26 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-13:33:29 ... thread 0: (1000000,1000000) ops and (334148.7,334148.7) ops/second in (2.992680,2.992680) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 440.41 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 351.6 2.50 2.33 13 0.193 0 0 0.0 0.0 L1 4/0 312.45 MB 31.2 0.3 0.3 0.0 0.3 0.3 0.1 1.0 249.9 248.5 1.26 1.23 1 1.257 319K 1809 0.0 0.0 L2 1/0 40.94 MB 0.4 0.3 0.1 0.1 0.3 0.1 0.0 2.1 244.8 244.4 1.06 1.03 2 0.528 262K 417 0.0 0.0 L3 16/1 749.36 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.0 1.0 227.6 227.6 0.52 0.51 1 0.525 121K 0 0.0 0.0 L4 124/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 116/0 8.92 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 268/5 20.09 GB 0.0 0.7 0.5 0.1 1.5 1.4 0.8 1.8 129.6 293.9 5.34 5.10 17 0.314 703K 2226 0.0 0.0 Int 0/0 0.00 KB 0.0 0.7 0.5 0.1 1.5 1.4 0.8 1.8 129.6 293.9 5.34 5.10 17 0.314 703K 2226 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.7 0.5 0.1 0.7 0.5 0.0 0.0 243.9 243.1 2.84 2.77 4 0.710 703K 2226 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 351.6 2.50 2.33 13 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.53 GB write, 513.50 MB/s write, 0.68 GB read, 226.34 MB/s read, 5.3 seconds Interval compaction: 1.53 GB write, 524.49 MB/s write, 0.68 GB read, 231.19 MB/s read, 5.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 154122 Average: 2.1039 StdDev: 5.32 Min: 1 Median: 1.4414 Max: 1240 Percentiles: P50: 1.44 P75: 1.84 P99: 5.77 P99.9: 11.15 P99.99: 173.92 ------------------------------------------------------ [ 0, 1 ] 34102 22.127% 22.127% #### ( 1, 2 ] 97325 63.148% 85.275% ############# ( 2, 3 ] 13453 8.729% 94.003% ## ( 3, 4 ] 4961 3.219% 97.222% # ( 4, 6 ] 3097 2.009% 99.232% ( 6, 10 ] 997 0.647% 99.879% ( 10, 15 ] 143 0.093% 99.971% ( 15, 22 ] 23 0.015% 99.986% ( 22, 34 ] 3 0.002% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 76, 110 ] 1 0.001% 99.990% ( 170, 250 ] 12 0.008% 99.997% ( 250, 380 ] 3 0.002% 99.999% ( 380, 580 ] 10 0.006% 100.006% ( 870, 1300 ] 1 0.001% 100.006% ** Level 1 read latency histogram (micros): Count: 8906 Average: 3.5893 StdDev: 32.23 Min: 1 Median: 1.1700 Max: 1708 Percentiles: P50: 1.17 P75: 1.63 P99: 13.74 P99.9: 297.41 P99.99: 1632.82 ------------------------------------------------------ [ 0, 1 ] 3629 40.748% 40.748% ######## ( 1, 2 ] 4846 54.413% 95.161% ########### ( 2, 3 ] 77 0.865% 96.025% ( 3, 4 ] 79 0.887% 96.912% ( 4, 6 ] 76 0.853% 97.766% ( 6, 10 ] 92 1.033% 98.799% ( 10, 15 ] 24 0.269% 99.068% ( 15, 22 ] 5 0.056% 99.124% ( 22, 34 ] 1 0.011% 99.135% ( 76, 110 ] 3 0.034% 99.169% ( 110, 170 ] 53 0.595% 99.764% ( 170, 250 ] 11 0.124% 99.888% ( 250, 380 ] 3 0.034% 99.921% ( 380, 580 ] 3 0.034% 99.955% ( 580, 870 ] 1 0.011% 99.966% ( 870, 1300 ] 1 0.011% 99.978% ( 1300, 1900 ] 2 0.022% 100.000% ** Level 2 read latency histogram (micros): Count: 55166 Average: 2.1533 StdDev: 4.02 Min: 1 Median: 1.4736 Max: 600 Percentiles: P50: 1.47 P75: 1.87 P99: 5.93 P99.9: 12.59 P99.99: 154.50 ------------------------------------------------------ [ 0, 1 ] 10921 19.797% 19.797% #### ( 1, 2 ] 35180 63.771% 83.568% ############# ( 2, 3 ] 5037 9.131% 92.698% ## ( 3, 4 ] 2120 3.843% 96.541% # ( 4, 6 ] 1406 2.549% 99.090% # ( 6, 10 ] 410 0.743% 99.833% ( 10, 15 ] 71 0.129% 99.962% ( 15, 22 ] 8 0.015% 99.976% ( 22, 34 ] 1 0.002% 99.978% ( 34, 51 ] 3 0.005% 99.984% ( 51, 76 ] 2 0.004% 99.987% ( 110, 170 ] 2 0.004% 99.991% ( 170, 250 ] 3 0.005% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 7452 Average: 22.0953 StdDev: 325.70 Min: 1 Median: 1.5265 Max: 8294 Percentiles: P50: 1.53 P75: 1.89 P99: 12.49 P99.9: 7167.60 P99.99: 8294.00 ------------------------------------------------------ [ 0, 1 ] 1052 14.117% 14.117% ### ( 1, 2 ] 5079 68.156% 82.273% ############## ( 2, 3 ] 795 10.668% 92.941% ## ( 3, 4 ] 204 2.738% 95.679% # ( 4, 6 ] 167 2.241% 97.920% ( 6, 10 ] 77 1.033% 98.953% ( 10, 15 ] 7 0.094% 99.047% ( 15, 22 ] 2 0.027% 99.074% ( 22, 34 ] 3 0.040% 99.114% ( 34, 51 ] 2 0.027% 99.141% ( 76, 110 ] 2 0.027% 99.168% ( 110, 170 ] 6 0.081% 99.249% ( 170, 250 ] 3 0.040% 99.289% ( 250, 380 ] 8 0.107% 99.396% ( 380, 580 ] 2 0.027% 99.423% ( 580, 870 ] 7 0.094% 99.517% ( 870, 1300 ] 8 0.107% 99.624% ( 1300, 1900 ] 7 0.094% 99.718% ( 1900, 2900 ] 4 0.054% 99.772% ( 2900, 4400 ] 2 0.027% 99.799% ( 4400, 6600 ] 6 0.081% 99.879% ( 6600, 9900 ] 9 0.121% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 3347.4667 StdDev: 2751.89 Min: 152 Median: 3150.0000 Max: 7954 Percentiles: P50: 3150.00 P75: 5316.67 P99: 7954.00 P99.9: 7954.00 P99.99: 7954.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 250, 380 ] 2 13.333% 20.000% ### ( 580, 870 ] 2 13.333% 33.333% ### ( 870, 1300 ] 1 6.667% 40.000% # ( 1900, 2900 ] 1 6.667% 46.667% # ( 2900, 4400 ] 3 20.000% 66.667% #### ( 4400, 6600 ] 3 20.000% 86.667% #### ( 6600, 9900 ] 2 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 449.4500 StdDev: 496.46 Min: 103 Median: 170.0000 Max: 2121 Percentiles: P50: 170.00 P75: 580.00 P99: 2121.00 P99.9: 2121.00 P99.99: 2121.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 6 30.000% 50.000% ###### ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 321.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.149 H:M:S, 4.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.149 H:M:S, 5.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-13:33:32 ... thread 0: (1000000,2000000) ops and (342366.8,338207.8) ops/second in (2.920844,5.913524) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 112.8 1.0 0.0 1.0 2.8 1.8 0.0 1.5 111.7 313.7 9.01 8.56 32 0.282 1022K 4843 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.1 1.0 249.9 248.5 1.26 1.23 1 1.257 319K 1809 0.0 0.0 L2 1/1 55.81 MB 0.0 0.3 0.1 0.2 0.3 0.1 0.3 2.2 241.3 240.5 1.31 1.27 3 0.435 319K 1100 0.0 0.0 L3 16/8 988.99 MB 0.4 0.4 0.3 0.1 0.4 0.3 0.1 1.3 221.2 220.6 1.65 1.60 3 0.550 370K 1005 0.0 0.0 L4 130/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 216.2 216.2 0.26 0.25 1 0.260 57K 0 0.0 0.0 L5 116/0 8.92 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 273/13 21.00 GB 0.0 2.0 0.8 1.2 3.8 2.6 1.2 2.1 152.6 287.3 13.48 12.91 40 0.337 2089K 8757 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.2 3.8 2.6 1.2 2.1 152.6 287.3 13.48 12.91 40 0.337 2089K 8757 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.2 2.0 0.8 0.0 0.0 246.0 245.0 8.36 8.17 12 0.697 2089K 8757 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.3 5.12 4.74 28 0.183 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.9 interval Flush(GB): cumulative 1.782, interval 1.782 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.78 GB write, 647.65 MB/s write, 2.01 GB read, 344.03 MB/s read, 13.5 seconds Interval compaction: 3.78 GB write, 654.67 MB/s write, 2.01 GB read, 347.76 MB/s read, 13.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 401428 Average: 2.3183 StdDev: 5.75 Min: 1 Median: 1.5730 Max: 1240 Percentiles: P50: 1.57 P75: 1.96 P99: 5.92 P99.9: 12.13 P99.99: 33.02 ------------------------------------------------------ [ 0, 1 ] 52044 12.965% 12.965% ### ( 1, 2 ] 259449 64.632% 77.596% ############# ( 2, 3 ] 55848 13.912% 91.509% ### ( 3, 4 ] 18240 4.544% 96.052% # ( 4, 6 ] 12332 3.072% 99.124% # ( 6, 10 ] 2896 0.721% 99.846% ( 10, 15 ] 513 0.128% 99.974% ( 15, 22 ] 54 0.013% 99.987% ( 22, 34 ] 14 0.003% 99.991% ( 34, 51 ] 6 0.001% 99.992% ( 51, 76 ] 2 0.000% 99.993% ( 76, 110 ] 1 0.000% 99.993% ( 170, 250 ] 27 0.007% 100.000% ( 250, 380 ] 4 0.001% 100.000% ( 380, 580 ] 25 0.006% 100.007% ( 580, 870 ] 2 0.000% 100.007% ( 870, 1300 ] 6 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 55545 Average: 2.8043 StdDev: 12.97 Min: 1 Median: 1.6968 Max: 1708 Percentiles: P50: 1.70 P75: 2.38 P99: 8.40 P99.9: 128.63 P99.99: 355.97 ------------------------------------------------------ [ 0, 1 ] 5023 9.043% 9.043% ## ( 1, 2 ] 32650 58.781% 67.824% ############ ( 2, 3 ] 10566 19.022% 86.847% #### ( 3, 4 ] 3443 6.199% 93.045% # ( 4, 6 ] 2943 5.298% 98.344% # ( 6, 10 ] 607 1.093% 99.436% ( 10, 15 ] 201 0.362% 99.798% ( 15, 22 ] 31 0.056% 99.854% ( 22, 34 ] 4 0.007% 99.861% ( 34, 51 ] 2 0.004% 99.865% ( 76, 110 ] 3 0.005% 99.870% ( 110, 170 ] 53 0.095% 99.966% ( 170, 250 ] 11 0.020% 99.986% ( 250, 380 ] 3 0.005% 99.991% ( 380, 580 ] 3 0.005% 99.996% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ( 1300, 1900 ] 2 0.004% 100.004% ** Level 2 read latency histogram (micros): Count: 70648 Average: 2.3457 StdDev: 5.25 Min: 1 Median: 1.5404 Max: 600 Percentiles: P50: 1.54 P75: 1.94 P99: 6.80 P99.9: 14.42 P99.99: 239.35 ------------------------------------------------------ [ 0, 1 ] 11364 16.085% 16.085% ### ( 1, 2 ] 44338 62.759% 78.844% ############# ( 2, 3 ] 8384 11.867% 90.712% ## ( 3, 4 ] 3272 4.631% 95.343% # ( 4, 6 ] 2451 3.469% 98.812% # ( 6, 10 ] 664 0.940% 99.752% ( 10, 15 ] 118 0.167% 99.919% ( 15, 22 ] 12 0.017% 99.936% ( 22, 34 ] 1 0.001% 99.938% ( 34, 51 ] 3 0.004% 99.942% ( 51, 76 ] 2 0.003% 99.945% ( 76, 110 ] 1 0.001% 99.946% ( 110, 170 ] 24 0.034% 99.980% ( 170, 250 ] 8 0.011% 99.992% ( 250, 380 ] 3 0.004% 99.996% ( 380, 580 ] 2 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 184442 Average: 3.5981 StdDev: 66.01 Min: 1 Median: 1.6715 Max: 8294 Percentiles: P50: 1.67 P75: 2.20 P99: 9.12 P99.9: 152.31 P99.99: 1276.12 ------------------------------------------------------ [ 0, 1 ] 11337 6.147% 6.147% # ( 1, 2 ] 120454 65.307% 71.454% ############# ( 2, 3 ] 32735 17.748% 89.202% #### ( 3, 4 ] 9043 4.903% 94.105% # ( 4, 6 ] 6400 3.470% 97.575% # ( 6, 10 ] 3368 1.826% 99.401% ( 10, 15 ] 424 0.230% 99.631% ( 15, 22 ] 51 0.028% 99.658% ( 22, 34 ] 13 0.007% 99.665% ( 34, 51 ] 172 0.093% 99.759% ( 51, 76 ] 77 0.042% 99.800% ( 76, 110 ] 52 0.028% 99.829% ( 110, 170 ] 188 0.102% 99.931% ( 170, 250 ] 62 0.034% 99.964% ( 250, 380 ] 25 0.014% 99.978% ( 380, 580 ] 7 0.004% 99.982% ( 580, 870 ] 9 0.005% 99.986% ( 870, 1300 ] 8 0.004% 99.991% ( 1300, 1900 ] 7 0.004% 99.995% ( 1900, 2900 ] 4 0.002% 99.997% ( 2900, 4400 ] 2 0.001% 99.998% ( 4400, 6600 ] 6 0.003% 100.001% ( 6600, 9900 ] 9 0.005% 100.006% ** Level 4 read latency histogram (micros): Count: 45 Average: 1138.0667 StdDev: 2228.78 Min: 1 Median: 40.3750 Max: 7954 Percentiles: P50: 40.38 P75: 688.75 P99: 7954.00 P99.9: 7954.00 P99.99: 7954.00 ------------------------------------------------------ [ 0, 1 ] 9 20.000% 20.000% #### ( 1, 2 ] 5 11.111% 31.111% ## ( 2, 3 ] 1 2.222% 33.333% ( 3, 4 ] 1 2.222% 35.556% ( 4, 6 ] 1 2.222% 37.778% ( 6, 10 ] 4 8.889% 46.667% ## ( 34, 51 ] 4 8.889% 55.556% ## ( 76, 110 ] 1 2.222% 57.778% ( 110, 170 ] 4 8.889% 66.667% ## ( 250, 380 ] 3 6.667% 73.333% # ( 580, 870 ] 2 4.444% 77.778% # ( 870, 1300 ] 1 2.222% 80.000% ( 1900, 2900 ] 1 2.222% 82.222% ( 2900, 4400 ] 3 6.667% 88.889% # ( 4400, 6600 ] 3 6.667% 95.556% # ( 6600, 9900 ] 2 4.444% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 449.4500 StdDev: 496.46 Min: 103 Median: 170.0000 Max: 2121 Percentiles: P50: 170.00 P75: 580.00 P99: 2121.00 P99.9: 2121.00 P99.99: 2121.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 6 30.000% 50.000% ###### ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 580, 870 ] 1 5.000% 80.000% # ( 870, 1300 ] 3 15.000% 95.000% ### ( 1900, 2900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 329.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.149 H:M:S, 2.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-13:33:35 ... thread 0: (1000000,3000000) ops and (352469.1,342831.6) ops/second in (2.837128,8.750652) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.33 GB 212.9 2.0 0.0 2.0 4.7 2.8 0.0 1.7 129.2 310.2 15.59 14.86 52 0.300 2044K 9561 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.1 1.0 249.9 248.5 1.26 1.23 1 1.257 319K 1809 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.3 2.2 241.3 240.5 1.31 1.27 3 0.435 319K 1100 0.0 0.0 L3 10/0 515.74 MB 0.5 1.0 0.3 0.7 1.0 0.3 0.1 3.0 230.0 226.7 4.57 4.40 4 1.142 1067K 15K 0.0 0.0 L4 126/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 216.2 216.2 0.26 0.25 1 0.260 57K 0 0.0 0.0 L5 124/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 274/4 21.96 GB 0.0 3.7 0.8 2.8 6.4 3.6 2.3 2.3 163.2 285.2 22.98 22.01 61 0.377 3807K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 0.8 2.8 6.4 3.6 2.3 2.3 163.2 285.2 22.98 22.01 61 0.377 3807K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 0.8 2.8 3.6 0.8 0.0 0.0 247.4 245.6 15.15 14.77 17 0.891 3807K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 361.8 7.82 7.24 44 0.178 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.8 total, 8.8 interval Flush(GB): cumulative 2.765, interval 2.765 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.40 GB write, 743.24 MB/s write, 3.66 GB read, 425.28 MB/s read, 23.0 seconds Interval compaction: 6.40 GB write, 748.68 MB/s write, 3.66 GB read, 428.40 MB/s read, 23.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 650321 Average: 2.2368 StdDev: 6.10 Min: 1 Median: 1.5271 Max: 1746 Percentiles: P50: 1.53 P75: 1.91 P99: 5.84 P99.9: 12.16 P99.99: 24.65 ------------------------------------------------------ [ 0, 1 ] 100569 15.465% 15.465% ### ( 1, 2 ] 426083 65.519% 80.983% ############# ( 2, 3 ] 78187 12.023% 93.006% ## ( 3, 4 ] 24705 3.799% 96.805% # ( 4, 6 ] 15554 2.392% 99.197% ( 6, 10 ] 4206 0.647% 99.844% ( 10, 15 ] 853 0.131% 99.975% ( 15, 22 ] 96 0.015% 99.990% ( 22, 34 ] 18 0.003% 99.992% ( 34, 51 ] 10 0.002% 99.994% ( 51, 76 ] 4 0.001% 99.994% ( 76, 110 ] 3 0.000% 99.995% ( 170, 250 ] 43 0.007% 100.002% ( 250, 380 ] 15 0.002% 100.004% ( 380, 580 ] 31 0.005% 100.009% ( 580, 870 ] 6 0.001% 100.010% ( 870, 1300 ] 8 0.001% 100.011% ( 1300, 1900 ] 1 0.000% 100.011% ** Level 1 read latency histogram (micros): Count: 55545 Average: 2.8043 StdDev: 12.97 Min: 1 Median: 1.6968 Max: 1708 Percentiles: P50: 1.70 P75: 2.38 P99: 8.40 P99.9: 128.63 P99.99: 355.97 ------------------------------------------------------ [ 0, 1 ] 5023 9.043% 9.043% ## ( 1, 2 ] 32650 58.781% 67.824% ############ ( 2, 3 ] 10566 19.022% 86.847% #### ( 3, 4 ] 3443 6.199% 93.045% # ( 4, 6 ] 2943 5.298% 98.344% # ( 6, 10 ] 607 1.093% 99.436% ( 10, 15 ] 201 0.362% 99.798% ( 15, 22 ] 31 0.056% 99.854% ( 22, 34 ] 4 0.007% 99.861% ( 34, 51 ] 2 0.004% 99.865% ( 76, 110 ] 3 0.005% 99.870% ( 110, 170 ] 53 0.095% 99.966% ( 170, 250 ] 11 0.020% 99.986% ( 250, 380 ] 3 0.005% 99.991% ( 380, 580 ] 3 0.005% 99.996% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ( 1300, 1900 ] 2 0.004% 100.004% ** Level 2 read latency histogram (micros): Count: 79739 Average: 2.3652 StdDev: 4.96 Min: 1 Median: 1.5585 Max: 600 Percentiles: P50: 1.56 P75: 1.96 P99: 7.18 P99.9: 14.20 P99.99: 230.26 ------------------------------------------------------ [ 0, 1 ] 11896 14.919% 14.919% ### ( 1, 2 ] 50085 62.811% 77.730% ############# ( 2, 3 ] 10162 12.744% 90.474% ### ( 3, 4 ] 3746 4.698% 95.172% # ( 4, 6 ] 2800 3.511% 98.683% # ( 6, 10 ] 856 1.074% 99.757% ( 10, 15 ] 136 0.171% 99.927% ( 15, 22 ] 13 0.016% 99.944% ( 22, 34 ] 1 0.001% 99.945% ( 34, 51 ] 3 0.004% 99.949% ( 51, 76 ] 2 0.003% 99.951% ( 76, 110 ] 1 0.001% 99.952% ( 110, 170 ] 24 0.030% 99.982% ( 170, 250 ] 8 0.010% 99.992% ( 250, 380 ] 3 0.004% 99.996% ( 380, 580 ] 2 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 194019 Average: 3.5686 StdDev: 64.52 Min: 1 Median: 1.6682 Max: 8294 Percentiles: P50: 1.67 P75: 2.19 P99: 9.11 P99.9: 152.44 P99.99: 1239.72 ------------------------------------------------------ [ 0, 1 ] 12206 6.291% 6.291% # ( 1, 2 ] 126920 65.416% 71.707% ############# ( 2, 3 ] 34211 17.633% 89.340% #### ( 3, 4 ] 9393 4.841% 94.181% # ( 4, 6 ] 6587 3.395% 97.577% # ( 6, 10 ] 3556 1.833% 99.409% ( 10, 15 ] 452 0.233% 99.642% ( 15, 22 ] 51 0.026% 99.669% ( 22, 34 ] 14 0.007% 99.676% ( 34, 51 ] 172 0.089% 99.764% ( 51, 76 ] 77 0.040% 99.804% ( 76, 110 ] 53 0.027% 99.831% ( 110, 170 ] 188 0.097% 99.928% ( 170, 250 ] 62 0.032% 99.960% ( 250, 380 ] 25 0.013% 99.973% ( 380, 580 ] 12 0.006% 99.979% ( 580, 870 ] 12 0.006% 99.986% ( 870, 1300 ] 10 0.005% 99.991% ( 1300, 1900 ] 7 0.004% 99.994% ( 1900, 2900 ] 4 0.002% 99.996% ( 2900, 4400 ] 2 0.001% 99.997% ( 4400, 6600 ] 6 0.003% 100.001% ( 6600, 9900 ] 9 0.005% 100.005% ** Level 4 read latency histogram (micros): Count: 45 Average: 1138.0667 StdDev: 2228.78 Min: 1 Median: 40.3750 Max: 7954 Percentiles: P50: 40.38 P75: 688.75 P99: 7954.00 P99.9: 7954.00 P99.99: 7954.00 ------------------------------------------------------ [ 0, 1 ] 9 20.000% 20.000% #### ( 1, 2 ] 5 11.111% 31.111% ## ( 2, 3 ] 1 2.222% 33.333% ( 3, 4 ] 1 2.222% 35.556% ( 4, 6 ] 1 2.222% 37.778% ( 6, 10 ] 4 8.889% 46.667% ## ( 34, 51 ] 4 8.889% 55.556% ## ( 76, 110 ] 1 2.222% 57.778% ( 110, 170 ] 4 8.889% 66.667% ## ( 250, 380 ] 3 6.667% 73.333% # ( 580, 870 ] 2 4.444% 77.778% # ( 870, 1300 ] 1 2.222% 80.000% ( 1900, 2900 ] 1 2.222% 82.222% ( 2900, 4400 ] 3 6.667% 88.889% # ( 4400, 6600 ] 3 6.667% 95.556% # ( 6600, 9900 ] 2 4.444% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 503.5667 StdDev: 532.77 Min: 103 Median: 250.0000 Max: 2497 Percentiles: P50: 250.00 P75: 725.00 P99: 2497.00 P99.9: 2497.00 P99.99: 2497.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 12 20.000% 30.000% #### ( 170, 250 ] 12 20.000% 50.000% #### ( 250, 380 ] 6 10.000% 60.000% ## ( 380, 580 ] 7 11.667% 71.667% ## ( 580, 870 ] 4 6.667% 78.333% # ( 870, 1300 ] 10 16.667% 95.000% ### ( 1900, 2900 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.8 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 334.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.149 H:M:S, 1.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 346.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/15-13:33:38 ... thread 0: (1000000,4000000) ops and (345543.2,343505.5) ops/second in (2.893994,11.644646) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.24 GB 306.8 2.9 0.0 2.9 6.6 3.7 0.0 1.8 136.9 307.3 22.06 21.06 71 0.311 3066K 14K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.1 1.0 249.9 248.5 1.26 1.23 1 1.257 319K 1809 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.3 2.2 241.3 240.5 1.31 1.27 3 0.435 319K 1100 0.0 0.0 L3 10/0 515.74 MB 0.5 1.0 0.3 0.7 1.0 0.3 0.1 3.0 230.0 226.7 4.57 4.40 4 1.142 1067K 15K 0.0 0.0 L4 126/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 216.2 216.2 0.26 0.25 1 0.260 57K 0 0.0 0.0 L5 124/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 277/4 22.88 GB 0.0 4.6 0.8 3.8 8.3 4.5 2.3 2.3 161.5 288.5 29.45 28.21 80 0.368 4829K 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 0.8 3.8 8.3 4.5 2.3 2.3 161.5 288.5 29.45 28.21 80 0.368 4829K 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 0.8 3.8 4.6 0.8 0.0 0.0 249.5 247.7 19.07 18.62 21 0.908 4829K 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 363.4 10.39 9.59 59 0.176 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.7 total, 11.6 interval Flush(GB): cumulative 3.686, interval 3.686 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.30 GB write, 725.67 MB/s write, 4.64 GB read, 406.13 MB/s read, 29.5 seconds Interval compaction: 8.30 GB write, 729.66 MB/s write, 4.64 GB read, 408.37 MB/s read, 29.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 4, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 901746 Average: 2.1895 StdDev: 6.04 Min: 0 Median: 1.5028 Max: 1746 Percentiles: P50: 1.50 P75: 1.88 P99: 5.75 P99.9: 11.90 P99.99: 21.40 ------------------------------------------------------ [ 0, 1 ] 151741 16.827% 16.827% ### ( 1, 2 ] 594989 65.982% 82.809% ############# ( 2, 3 ] 99342 11.017% 93.826% ## ( 3, 4 ] 30642 3.398% 97.224% # ( 4, 6 ] 18295 2.029% 99.253% ( 6, 10 ] 5405 0.599% 99.852% ( 10, 15 ] 1133 0.126% 99.978% ( 15, 22 ] 119 0.013% 99.991% ( 22, 34 ] 24 0.003% 99.994% ( 34, 51 ] 12 0.001% 99.995% ( 51, 76 ] 7 0.001% 99.996% ( 76, 110 ] 3 0.000% 99.996% ( 170, 250 ] 58 0.006% 100.003% ( 250, 380 ] 18 0.002% 100.005% ( 380, 580 ] 43 0.005% 100.009% ( 580, 870 ] 11 0.001% 100.011% ( 870, 1300 ] 11 0.001% 100.012% ( 1300, 1900 ] 1 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 55545 Average: 2.8043 StdDev: 12.97 Min: 1 Median: 1.6968 Max: 1708 Percentiles: P50: 1.70 P75: 2.38 P99: 8.40 P99.9: 128.63 P99.99: 355.97 ------------------------------------------------------ [ 0, 1 ] 5023 9.043% 9.043% ## ( 1, 2 ] 32650 58.781% 67.824% ############ ( 2, 3 ] 10566 19.022% 86.847% #### ( 3, 4 ] 3443 6.199% 93.045% # ( 4, 6 ] 2943 5.298% 98.344% # ( 6, 10 ] 607 1.093% 99.436% ( 10, 15 ] 201 0.362% 99.798% ( 15, 22 ] 31 0.056% 99.854% ( 22, 34 ] 4 0.007% 99.861% ( 34, 51 ] 2 0.004% 99.865% ( 76, 110 ] 3 0.005% 99.870% ( 110, 170 ] 53 0.095% 99.966% ( 170, 250 ] 11 0.020% 99.986% ( 250, 380 ] 3 0.005% 99.991% ( 380, 580 ] 3 0.005% 99.996% ( 580, 870 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ( 1300, 1900 ] 2 0.004% 100.004% ** Level 2 read latency histogram (micros): Count: 79739 Average: 2.3652 StdDev: 4.96 Min: 1 Median: 1.5585 Max: 600 Percentiles: P50: 1.56 P75: 1.96 P99: 7.18 P99.9: 14.20 P99.99: 230.26 ------------------------------------------------------ [ 0, 1 ] 11896 14.919% 14.919% ### ( 1, 2 ] 50085 62.811% 77.730% ############# ( 2, 3 ] 10162 12.744% 90.474% ### ( 3, 4 ] 3746 4.698% 95.172% # ( 4, 6 ] 2800 3.511% 98.683% # ( 6, 10 ] 856 1.074% 99.757% ( 10, 15 ] 136 0.171% 99.927% ( 15, 22 ] 13 0.016% 99.944% ( 22, 34 ] 1 0.001% 99.945% ( 34, 51 ] 3 0.004% 99.949% ( 51, 76 ] 2 0.003% 99.951% ( 76, 110 ] 1 0.001% 99.952% ( 110, 170 ] 24 0.030% 99.982% ( 170, 250 ] 8 0.010% 99.992% ( 250, 380 ] 3 0.004% 99.996% ( 380, 580 ] 2 0.003% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 194019 Average: 3.5686 StdDev: 64.52 Min: 1 Median: 1.6682 Max: 8294 Percentiles: P50: 1.67 P75: 2.19 P99: 9.11 P99.9: 152.44 P99.99: 1239.72 ------------------------------------------------------ [ 0, 1 ] 12206 6.291% 6.291% # ( 1, 2 ] 126920 65.416% 71.707% ############# ( 2, 3 ] 34211 17.633% 89.340% #### ( 3, 4 ] 9393 4.841% 94.181% # ( 4, 6 ] 6587 3.395% 97.577% # ( 6, 10 ] 3556 1.833% 99.409% ( 10, 15 ] 452 0.233% 99.642% ( 15, 22 ] 51 0.026% 99.669% ( 22, 34 ] 14 0.007% 99.676% ( 34, 51 ] 172 0.089% 99.764% ( 51, 76 ] 77 0.040% 99.804% ( 76, 110 ] 53 0.027% 99.831% ( 110, 170 ] 188 0.097% 99.928% ( 170, 250 ] 62 0.032% 99.960% ( 250, 380 ] 25 0.013% 99.973% ( 380, 580 ] 12 0.006% 99.979% ( 580, 870 ] 12 0.006% 99.986% ( 870, 1300 ] 10 0.005% 99.991% ( 1300, 1900 ] 7 0.004% 99.994% ( 1900, 2900 ] 4 0.002% 99.996% ( 2900, 4400 ] 2 0.001% 99.997% ( 4400, 6600 ] 6 0.003% 100.001% ( 6600, 9900 ] 9 0.005% 100.005% ** Level 4 read latency histogram (micros): Count: 45 Average: 1138.0667 StdDev: 2228.78 Min: 1 Median: 40.3750 Max: 7954 Percentiles: P50: 40.38 P75: 688.75 P99: 7954.00 P99.9: 7954.00 P99.99: 7954.00 ------------------------------------------------------ [ 0, 1 ] 9 20.000% 20.000% #### ( 1, 2 ] 5 11.111% 31.111% ## ( 2, 3 ] 1 2.222% 33.333% ( 3, 4 ] 1 2.222% 35.556% ( 4, 6 ] 1 2.222% 37.778% ( 6, 10 ] 4 8.889% 46.667% ## ( 34, 51 ] 4 8.889% 55.556% ## ( 76, 110 ] 1 2.222% 57.778% ( 110, 170 ] 4 8.889% 66.667% ## ( 250, 380 ] 3 6.667% 73.333% # ( 580, 870 ] 2 4.444% 77.778% # ( 870, 1300 ] 1 2.222% 80.000% ( 1900, 2900 ] 1 2.222% 82.222% ( 2900, 4400 ] 3 6.667% 88.889% # ( 4400, 6600 ] 3 6.667% 95.556% # ( 6600, 9900 ] 2 4.444% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 503.5667 StdDev: 532.77 Min: 103 Median: 250.0000 Max: 2497 Percentiles: P50: 250.00 P75: 725.00 P99: 2497.00 P99.9: 2497.00 P99.99: 2497.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 12 20.000% 30.000% #### ( 170, 250 ] 12 20.000% 50.000% #### ( 250, 380 ] 6 10.000% 60.000% ## ( 380, 580 ] 7 11.667% 71.667% ## ( 580, 870 ] 4 6.667% 78.333% # ( 870, 1300 ] 10 16.667% 95.000% ### ( 1900, 2900 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 11.7 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 336.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.186 H:M:S, 1.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 340.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.037 H:M:S, 1.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.123 micros/op 242549 ops/sec 20.173 seconds 4892999 operations; 235.0 MB/s Microseconds per write: Count: 4892999 Average: 4.1228 StdDev: 75.62 Min: 1 Median: 1.7860 Max: 136893 Percentiles: P50: 1.79 P75: 3.07 P99: 8.89 P99.9: 171.84 P99.99: 2367.36 ------------------------------------------------------ [ 0, 1 ] 584289 11.941% 11.941% ## ( 1, 2 ] 2369352 48.423% 60.365% ########## ( 2, 3 ] 666683 13.625% 73.990% ### ( 3, 4 ] 673796 13.771% 87.760% ### ( 4, 6 ] 503916 10.299% 98.059% ## ( 6, 10 ] 63685 1.302% 99.361% ( 10, 15 ] 15996 0.327% 99.688% ( 15, 22 ] 4652 0.095% 99.783% ( 22, 34 ] 993 0.020% 99.803% ( 34, 51 ] 131 0.003% 99.806% ( 51, 76 ] 18 0.000% 99.806% ( 76, 110 ] 3 0.000% 99.806% ( 110, 170 ] 4585 0.094% 99.900% ( 170, 250 ] 305 0.006% 99.906% ( 250, 380 ] 68 0.001% 99.907% ( 380, 580 ] 12 0.000% 99.908% ( 580, 870 ] 4 0.000% 99.908% ( 870, 1300 ] 3593 0.073% 99.981% ( 1300, 1900 ] 2 0.000% 99.981% ( 1900, 2900 ] 913 0.019% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 175817 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4892999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5049574968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 156 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5927898 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 7670448705 rocksdb.compact.write.bytes COUNT : 7496823427 rocksdb.flush.write.bytes COUNT : 5013469592 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 19 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 92 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4979852288 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8154112 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 7714733559 rocksdb.non.last.level.read.count COUNT : 1860581 rocksdb.block.checksum.compute.count COUNT : 1860288 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.441378 P95 : 4.775013 P99 : 7.401720 P100 : 136889.000000 COUNT : 4892999 SUM : 17863911 rocksdb.compaction.times.micros P50 : 976875.000000 P95 : 1725000.000000 P99 : 2918714.000000 P100 : 2918714.000000 COUNT : 25 SUM : 22847123 rocksdb.compaction.times.cpu_micros P50 : 976875.000000 P95 : 1725000.000000 P99 : 2650000.000000 P100 : 2804095.000000 COUNT : 25 SUM : 22346873 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 562.500000 P95 : 1171.000000 P99 : 1171.000000 P100 : 1171.000000 COUNT : 75 SUM : 50413 rocksdb.compaction.outfile.sync.micros P50 : 689.729730 P95 : 1285.666667 P99 : 1581.000000 P100 : 1581.000000 COUNT : 64 SUM : 45836 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 84.185185 P95 : 306.062500 P99 : 378.212500 P100 : 427.000000 COUNT : 111 SUM : 12996 rocksdb.table.open.io.micros P50 : 798.493151 P95 : 15760.000000 P99 : 18704.000000 P100 : 18704.000000 COUNT : 156 SUM : 375088 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.510830 P95 : 5.919974 P99 : 9.699903 P100 : 901.000000 COUNT : 1859916 SUM : 8045644 rocksdb.read.block.get.micros P50 : 392.698413 P95 : 5335.000000 P99 : 8648.000000 P100 : 8648.000000 COUNT : 312 SUM : 281047 rocksdb.write.raw.block.micros P50 : 0.510738 P95 : 0.970403 P99 : 2.866009 P100 : 2273.000000 COUNT : 3030302 SUM : 5591886 rocksdb.numfiles.in.singlecompaction P50 : 3.347826 P95 : 6.800000 P99 : 17.000000 P100 : 17.000000 COUNT : 36 SUM : 140 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567621 P95 : 1181.830737 P99 : 2485.334064 P100 : 136663.000000 COUNT : 38059 SUM : 5932460 rocksdb.sst.read.micros P50 : 1.482080 P95 : 3.358422 P99 : 5.977445 P100 : 8294.000000 COUNT : 1860758 SUM : 4453827 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4892999 SUM : 5049574968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 160000.000000 P95 : 245000.000000 P99 : 331250.000000 P100 : 342564.000000 COUNT : 75 SUM : 13071199 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 96 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0