[2024-12-10 05:36:01.478693] Starting SPDK v25.01-pre git sha1 4fb5f9881 / DPDK 24.03.0 initialization... [2024-12-10 05:36:01.479011] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1553223 ] Set seed to 1733805361471473 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-10 05:36:01.633428] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-10 05:36:01.736572] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-10 05:36:01.736633] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1553223' to capture a snapshot of events at runtime. [2024-12-10 05:36:01.736646] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-10 05:36:01.736660] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-10 05:36:01.736670] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1553223 for offline analysis/debug. [2024-12-10 05:36:01.737937] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 10 05:36:04 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/10-05:36:11 ... thread 0: (1000000,1000000) ops and (147579.5,147579.5) ops/second in (6.776009,6.776009) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 878.44 MB 25.1 0.3 0.0 0.3 1.2 0.9 0.0 1.4 38.0 144.0 8.28 4.01 12 0.690 319K 1782 0.0 0.0 L1 1/1 61.93 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.2 94.4 93.9 2.83 1.39 1 2.835 271K 1455 0.0 0.0 L2 3/1 272.68 MB 1.4 0.3 0.2 0.1 0.3 0.2 0.0 1.6 105.3 104.9 3.16 1.74 2 1.581 338K 1456 0.0 0.0 L3 31/15 1.90 GB 0.9 2.4 1.8 0.7 2.3 1.7 0.1 1.3 107.2 103.0 23.18 12.29 10 2.318 1760K 4880 0.0 0.0 L4 159/29 11.70 GB 1.0 2.5 1.6 0.9 2.4 1.5 0.4 1.5 117.9 113.6 21.96 12.48 12 1.830 510K 0 0.0 0.0 L5 116/0 9.29 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 318/51 24.07 GB 0.0 5.8 3.8 2.1 6.5 4.5 0.4 7.6 100.8 112.3 59.42 31.92 37 1.606 3199K 9573 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 3.8 2.1 6.5 4.5 0.4 7.6 100.8 112.3 59.42 31.92 37 1.606 3199K 9573 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 3.8 2.1 5.7 3.6 0.0 0.0 112.5 108.8 53.23 29.33 26 2.047 3199K 9573 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 142.3 6.19 2.59 11 0.562 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.9 total, 6.8 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.52 GB write, 972.81 MB/s write, 5.85 GB read, 872.96 MB/s read, 59.4 seconds Interval compaction: 6.52 GB write, 984.50 MB/s write, 5.85 GB read, 883.46 MB/s read, 59.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 137667 Average: 34.0691 StdDev: 301.00 Min: 1 Median: 2.1380 Max: 23752 Percentiles: P50: 2.14 P75: 3.14 P99: 838.74 P99.9: 4241.92 P99.99: 8916.87 ------------------------------------------------------ [ 0, 1 ] 3044 2.211% 2.211% ( 1, 2 ] 60594 44.015% 46.226% ######### ( 2, 3 ] 37642 27.343% 73.569% ##### ( 3, 4 ] 13808 10.030% 83.599% ## ( 4, 6 ] 14456 10.501% 94.100% ## ( 6, 10 ] 3519 2.556% 96.656% # ( 10, 15 ] 874 0.635% 97.291% ( 15, 22 ] 148 0.108% 97.398% ( 22, 34 ] 12 0.009% 97.407% ( 34, 51 ] 13 0.009% 97.416% ( 51, 76 ] 8 0.006% 97.422% ( 76, 110 ] 4 0.003% 97.425% ( 110, 170 ] 23 0.017% 97.442% ( 170, 250 ] 119 0.086% 97.528% ( 250, 380 ] 359 0.261% 97.789% ( 380, 580 ] 892 0.648% 98.437% ( 580, 870 ] 869 0.631% 99.068% ( 870, 1300 ] 435 0.316% 99.384% ( 1300, 1900 ] 218 0.158% 99.542% ( 1900, 2900 ] 232 0.169% 99.711% ( 2900, 4400 ] 291 0.211% 99.922% ( 4400, 6600 ] 82 0.060% 99.982% ( 6600, 9900 ] 16 0.012% 99.993% ( 9900, 14000 ] 2 0.001% 99.995% ( 14000, 22000 ] 6 0.004% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 65873 Average: 18.1940 StdDev: 302.84 Min: 1 Median: 2.3057 Max: 33788 Percentiles: P50: 2.31 P75: 3.24 P99: 14.70 P99.9: 3729.37 P99.99: 6940.48 ------------------------------------------------------ [ 0, 1 ] 333 0.506% 0.506% ( 1, 2 ] 26157 39.708% 40.214% ######## ( 2, 3 ] 21088 32.013% 72.227% ###### ( 3, 4 ] 7508 11.398% 83.625% ## ( 4, 6 ] 7800 11.841% 95.466% ## ( 6, 10 ] 1957 2.971% 98.436% # ( 10, 15 ] 395 0.600% 99.036% ( 15, 22 ] 42 0.064% 99.100% ( 22, 34 ] 13 0.020% 99.120% ( 34, 51 ] 27 0.041% 99.161% ( 51, 76 ] 10 0.015% 99.176% ( 76, 110 ] 5 0.008% 99.183% ( 110, 170 ] 15 0.023% 99.206% ( 170, 250 ] 18 0.027% 99.233% ( 250, 380 ] 47 0.071% 99.305% ( 380, 580 ] 102 0.155% 99.460% ( 580, 870 ] 99 0.150% 99.610% ( 870, 1300 ] 47 0.071% 99.681% ( 1300, 1900 ] 35 0.053% 99.734% ( 1900, 2900 ] 66 0.100% 99.835% ( 2900, 4400 ] 78 0.118% 99.953% ( 4400, 6600 ] 24 0.036% 99.989% ( 6600, 9900 ] 4 0.006% 99.995% ( 9900, 14000 ] 2 0.003% 99.998% ( 14000, 22000 ] 3 0.005% 100.003% ( 22000, 33000 ] 2 0.003% 100.006% ( 33000, 50000 ] 1 0.002% 100.008% ** Level 2 read latency histogram (micros): Count: 424096 Average: 16.8741 StdDev: 272.97 Min: 1 Median: 2.2778 Max: 48460 Percentiles: P50: 2.28 P75: 3.32 P99: 14.22 P99.9: 1891.47 P99.99: 2888.46 ------------------------------------------------------ [ 0, 1 ] 4177 0.985% 0.985% ( 1, 2 ] 172946 40.780% 41.765% ######## ( 2, 3 ] 125732 29.647% 71.412% ###### ( 3, 4 ] 47852 11.283% 82.695% ## ( 4, 6 ] 52806 12.451% 95.147% ## ( 6, 10 ] 13074 3.083% 98.229% # ( 10, 15 ] 3874 0.913% 99.143% ( 15, 22 ] 666 0.157% 99.300% ( 22, 34 ] 98 0.023% 99.323% ( 34, 51 ] 105 0.025% 99.348% ( 51, 76 ] 79 0.019% 99.366% ( 76, 110 ] 25 0.006% 99.372% ( 110, 170 ] 23 0.005% 99.378% ( 170, 250 ] 90 0.021% 99.399% ( 250, 380 ] 304 0.072% 99.471% ( 380, 580 ] 597 0.141% 99.611% ( 580, 870 ] 573 0.135% 99.747% ( 870, 1300 ] 367 0.087% 99.833% ( 1300, 1900 ] 288 0.068% 99.901% ( 1900, 2900 ] 382 0.090% 99.991% ( 2900, 4400 ] 399 0.094% 100.085% ( 4400, 6600 ] 155 0.037% 100.122% ( 6600, 9900 ] 49 0.012% 100.133% ( 9900, 14000 ] 9 0.002% 100.135% ( 14000, 22000 ] 12 0.003% 100.138% ( 22000, 33000 ] 5 0.001% 100.139% ( 33000, 50000 ] 4 0.001% 100.140% ** Level 3 read latency histogram (micros): Count: 622152 Average: 17.1439 StdDev: 242.53 Min: 1 Median: 2.3325 Max: 56006 Percentiles: P50: 2.33 P75: 3.32 P99: 14.71 P99.9: 1401.01 P99.99: 2328.16 ------------------------------------------------------ [ 0, 1 ] 4031 0.648% 0.648% ( 1, 2 ] 240901 38.721% 39.369% ######## ( 2, 3 ] 198936 31.975% 71.344% ###### ( 3, 4 ] 71081 11.425% 82.769% ## ( 4, 6 ] 77852 12.513% 95.282% ### ( 6, 10 ] 19016 3.056% 98.339% # ( 10, 15 ] 4370 0.702% 99.041% ( 15, 22 ] 637 0.102% 99.144% ( 22, 34 ] 77 0.012% 99.156% ( 34, 51 ] 169 0.027% 99.183% ( 51, 76 ] 139 0.022% 99.205% ( 76, 110 ] 42 0.007% 99.212% ( 110, 170 ] 55 0.009% 99.221% ( 170, 250 ] 194 0.031% 99.252% ( 250, 380 ] 644 0.104% 99.356% ( 380, 580 ] 1366 0.220% 99.575% ( 580, 870 ] 1275 0.205% 99.780% ( 870, 1300 ] 677 0.109% 99.889% ( 1300, 1900 ] 403 0.065% 99.954% ( 1900, 2900 ] 525 0.084% 100.038% ( 2900, 4400 ] 710 0.114% 100.152% ( 4400, 6600 ] 186 0.030% 100.182% ( 6600, 9900 ] 43 0.007% 100.189% ( 9900, 14000 ] 3 0.000% 100.190% ( 14000, 22000 ] 7 0.001% 100.191% ( 22000, 33000 ] 7 0.001% 100.192% ( 33000, 50000 ] 3 0.000% 100.192% ( 50000, 75000 ] 1 0.000% 100.193% ** Level 4 read latency histogram (micros): Count: 515165 Average: 31.7425 StdDev: 326.38 Min: 1 Median: 2.3699 Max: 54466 Percentiles: P50: 2.37 P75: 3.47 P99: 711.64 P99.9: 3148.16 P99.99: 3787.97 ------------------------------------------------------ [ 0, 1 ] 3808 0.739% 0.739% ( 1, 2 ] 195043 37.860% 38.599% ######## ( 2, 3 ] 158760 30.817% 69.417% ###### ( 3, 4 ] 60887 11.819% 81.236% ## ( 4, 6 ] 65484 12.711% 93.947% ### ( 6, 10 ] 15229 2.956% 96.903% # ( 10, 15 ] 3766 0.731% 97.634% ( 15, 22 ] 587 0.114% 97.748% ( 22, 34 ] 94 0.018% 97.766% ( 34, 51 ] 134 0.026% 97.792% ( 51, 76 ] 145 0.028% 97.821% ( 76, 110 ] 41 0.008% 97.828% ( 110, 170 ] 102 0.020% 97.848% ( 170, 250 ] 386 0.075% 97.923% ( 250, 380 ] 1351 0.262% 98.185% ( 380, 580 ] 2953 0.573% 98.759% ( 580, 870 ] 2739 0.532% 99.290% ( 870, 1300 ] 1416 0.275% 99.565% ( 1300, 1900 ] 696 0.135% 99.700% ( 1900, 2900 ] 849 0.165% 99.865% ( 2900, 4400 ] 1087 0.211% 100.076% ( 4400, 6600 ] 304 0.059% 100.135% ( 6600, 9900 ] 41 0.008% 100.143% ( 9900, 14000 ] 6 0.001% 100.144% ( 14000, 22000 ] 5 0.001% 100.145% ( 22000, 33000 ] 4 0.001% 100.146% ( 33000, 50000 ] 6 0.001% 100.147% ( 50000, 75000 ] 2 0.000% 100.148% ** Level 5 read latency histogram (micros): Count: 7883 Average: 1175.4134 StdDev: 2067.39 Min: 115 Median: 682.7391 Max: 81641 Percentiles: P50: 682.74 P75: 1181.18 P99: 6126.35 P99.9: 28143.50 P99.99: 81641.00 ------------------------------------------------------ ( 110, 170 ] 42 0.533% 0.533% ( 170, 250 ] 278 3.527% 4.059% # ( 250, 380 ] 927 11.759% 15.819% ## ( 380, 580 ] 1998 25.346% 41.165% ##### ( 580, 870 ] 1966 24.940% 66.104% ##### ( 870, 1300 ] 969 12.292% 78.397% ## ( 1300, 1900 ] 403 5.112% 83.509% # ( 1900, 2900 ] 433 5.493% 89.002% # ( 2900, 4400 ] 643 8.157% 97.158% ## ( 4400, 6600 ] 185 2.347% 99.505% ( 6600, 9900 ] 28 0.355% 99.860% ( 14000, 22000 ] 2 0.025% 99.886% ( 22000, 33000 ] 2 0.025% 99.911% ( 33000, 50000 ] 3 0.038% 99.949% ( 50000, 75000 ] 3 0.038% 99.987% ( 75000, 110000 ] 1 0.013% 100.000% ** DB Stats ** Uptime(secs): 6.9 total, 6.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 143.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.003 H:M:S, 29.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 145.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.003 H:M:S, 29.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/10-05:36:16 ... thread 0: (1000000,2000000) ops and (221271.7,177064.2) ops/second in (4.519330,11.295339) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.78 GB 93.9 1.1 0.0 1.1 2.9 1.8 0.0 1.6 68.8 179.2 16.46 10.16 29 0.567 1149K 6007 0.0 0.0 L1 1/1 61.93 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.2 94.4 93.9 2.83 1.39 1 2.835 271K 1455 0.0 0.0 L2 1/1 103.49 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.6 105.3 104.9 3.16 1.74 2 1.581 338K 1456 0.0 0.0 L3 18/6 1009.34 MB 0.7 3.0 1.9 1.1 2.9 1.8 0.1 1.5 111.6 107.8 27.10 15.03 11 2.463 2308K 10K 0.0 0.0 L4 144/0 9.55 GB 1.0 6.5 2.4 4.1 5.8 1.7 0.6 2.4 140.0 124.4 47.65 30.69 24 1.986 1326K 0 0.0 0.0 L5 151/0 11.87 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 328/17 24.35 GB 0.0 11.2 4.7 6.4 12.1 5.7 3.3 6.8 117.6 127.5 97.20 59.01 67 1.451 5394K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.2 4.7 6.4 12.1 5.7 3.3 6.8 117.6 127.5 97.20 59.01 67 1.451 5394K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.2 4.7 6.4 10.3 3.9 0.0 0.0 131.8 121.9 86.70 53.64 42 2.064 5394K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 173.7 10.50 5.37 25 0.420 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.4 total, 11.3 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.11 GB write, 1089.31 MB/s write, 11.16 GB read, 1004.28 MB/s read, 97.2 seconds Interval compaction: 12.11 GB write, 1097.17 MB/s write, 11.16 GB read, 1011.52 MB/s read, 97.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 372153 Average: 32.4741 StdDev: 302.03 Min: 1 Median: 1.9499 Max: 38987 Percentiles: P50: 1.95 P75: 2.94 P99: 682.57 P99.9: 3461.54 P99.99: 5667.21 ------------------------------------------------------ [ 0, 1 ] 15023 4.037% 4.037% # ( 1, 2 ] 180084 48.390% 52.427% ########## ( 2, 3 ] 89532 24.058% 76.484% ##### ( 3, 4 ] 31745 8.530% 85.014% ## ( 4, 6 ] 29821 8.013% 93.028% ## ( 6, 10 ] 7170 1.927% 94.954% ( 10, 15 ] 1567 0.421% 95.375% ( 15, 22 ] 234 0.063% 95.438% ( 22, 34 ] 27 0.007% 95.445% ( 34, 51 ] 36 0.010% 95.455% ( 51, 76 ] 16 0.004% 95.459% ( 76, 110 ] 35 0.009% 95.469% ( 110, 170 ] 914 0.246% 95.714% ( 170, 250 ] 4040 1.086% 96.800% ( 250, 380 ] 3754 1.009% 97.809% ( 380, 580 ] 3615 0.971% 98.780% ( 580, 870 ] 2317 0.623% 99.403% ( 870, 1300 ] 882 0.237% 99.640% ( 1300, 1900 ] 339 0.091% 99.731% ( 1900, 2900 ] 468 0.126% 99.857% ( 2900, 4400 ] 435 0.117% 99.973% ( 4400, 6600 ] 109 0.029% 100.003% ( 6600, 9900 ] 24 0.006% 100.009% ( 9900, 14000 ] 9 0.002% 100.012% ( 14000, 22000 ] 14 0.004% 100.015% ( 22000, 33000 ] 10 0.003% 100.018% ( 33000, 50000 ] 3 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 66059 Average: 19.2962 StdDev: 304.20 Min: 1 Median: 2.3101 Max: 33788 Percentiles: P50: 2.31 P75: 3.26 P99: 207.77 P99.9: 3753.31 P99.99: 6925.13 ------------------------------------------------------ [ 0, 1 ] 333 0.504% 0.504% ( 1, 2 ] 26157 39.596% 40.101% ######## ( 2, 3 ] 21088 31.923% 72.023% ###### ( 3, 4 ] 7508 11.366% 83.389% ## ( 4, 6 ] 7800 11.808% 95.197% ## ( 6, 10 ] 1957 2.963% 98.159% # ( 10, 15 ] 395 0.598% 98.757% ( 15, 22 ] 42 0.064% 98.821% ( 22, 34 ] 13 0.020% 98.840% ( 34, 51 ] 27 0.041% 98.881% ( 51, 76 ] 10 0.015% 98.896% ( 76, 110 ] 5 0.008% 98.904% ( 110, 170 ] 28 0.042% 98.946% ( 170, 250 ] 75 0.114% 99.060% ( 250, 380 ] 102 0.154% 99.214% ( 380, 580 ] 133 0.201% 99.416% ( 580, 870 ] 121 0.183% 99.599% ( 870, 1300 ] 52 0.079% 99.678% ( 1300, 1900 ] 35 0.053% 99.731% ( 1900, 2900 ] 67 0.101% 99.832% ( 2900, 4400 ] 79 0.120% 99.952% ( 4400, 6600 ] 25 0.038% 99.989% ( 6600, 9900 ] 4 0.006% 99.995% ( 9900, 14000 ] 2 0.003% 99.998% ( 14000, 22000 ] 3 0.005% 100.003% ( 22000, 33000 ] 2 0.003% 100.006% ( 33000, 50000 ] 1 0.002% 100.008% ** Level 2 read latency histogram (micros): Count: 466530 Average: 16.6309 StdDev: 275.15 Min: 1 Median: 2.2543 Max: 48460 Percentiles: P50: 2.25 P75: 3.26 P99: 14.63 P99.9: 1866.38 P99.99: 2927.01 ------------------------------------------------------ [ 0, 1 ] 4638 0.994% 0.994% ( 1, 2 ] 193366 41.448% 42.442% ######## ( 2, 3 ] 138644 29.718% 72.160% ###### ( 3, 4 ] 51263 10.988% 83.148% ## ( 4, 6 ] 56158 12.037% 95.186% ## ( 6, 10 ] 14080 3.018% 98.204% # ( 10, 15 ] 4009 0.859% 99.063% ( 15, 22 ] 684 0.147% 99.209% ( 22, 34 ] 98 0.021% 99.230% ( 34, 51 ] 108 0.023% 99.254% ( 51, 76 ] 80 0.017% 99.271% ( 76, 110 ] 26 0.006% 99.276% ( 110, 170 ] 81 0.017% 99.294% ( 170, 250 ] 276 0.059% 99.353% ( 250, 380 ] 464 0.099% 99.452% ( 380, 580 ] 763 0.164% 99.616% ( 580, 870 ] 654 0.140% 99.756% ( 870, 1300 ] 393 0.084% 99.840% ( 1300, 1900 ] 295 0.063% 99.904% ( 1900, 2900 ] 396 0.085% 99.988% ( 2900, 4400 ] 408 0.087% 100.076% ( 4400, 6600 ] 158 0.034% 100.110% ( 6600, 9900 ] 50 0.011% 100.120% ( 9900, 14000 ] 9 0.002% 100.122% ( 14000, 22000 ] 13 0.003% 100.125% ( 22000, 33000 ] 8 0.002% 100.127% ( 33000, 50000 ] 5 0.001% 100.128% ** Level 3 read latency histogram (micros): Count: 905167 Average: 15.5374 StdDev: 238.49 Min: 1 Median: 2.2858 Max: 56006 Percentiles: P50: 2.29 P75: 3.23 P99: 21.62 P99.9: 1202.59 P99.99: 2200.48 ------------------------------------------------------ [ 0, 1 ] 7336 0.810% 0.810% ( 1, 2 ] 363680 40.178% 40.989% ######## ( 2, 3 ] 285413 31.532% 72.520% ###### ( 3, 4 ] 99163 10.955% 83.475% ## ( 4, 6 ] 107297 11.854% 95.329% ## ( 6, 10 ] 26652 2.944% 98.274% # ( 10, 15 ] 5794 0.640% 98.914% ( 15, 22 ] 825 0.091% 99.005% ( 22, 34 ] 115 0.013% 99.018% ( 34, 51 ] 257 0.028% 99.046% ( 51, 76 ] 178 0.020% 99.066% ( 76, 110 ] 56 0.006% 99.072% ( 110, 170 ] 311 0.034% 99.106% ( 170, 250 ] 1131 0.125% 99.231% ( 250, 380 ] 1594 0.176% 99.407% ( 380, 580 ] 2122 0.234% 99.642% ( 580, 870 ] 1709 0.189% 99.831% ( 870, 1300 ] 813 0.090% 99.920% ( 1300, 1900 ] 452 0.050% 99.970% ( 1900, 2900 ] 594 0.066% 100.036% ( 2900, 4400 ] 770 0.085% 100.121% ( 4400, 6600 ] 201 0.022% 100.143% ( 6600, 9900 ] 70 0.008% 100.151% ( 9900, 14000 ] 15 0.002% 100.153% ( 14000, 22000 ] 15 0.002% 100.154% ( 22000, 33000 ] 11 0.001% 100.155% ( 33000, 50000 ] 5 0.001% 100.156% ( 50000, 75000 ] 1 0.000% 100.156% ** Level 4 read latency histogram (micros): Count: 1073391 Average: 26.1469 StdDev: 315.82 Min: 0 Median: 2.2935 Max: 54466 Percentiles: P50: 2.29 P75: 3.35 P99: 503.29 P99.9: 1997.73 P99.99: 2814.34 ------------------------------------------------------ [ 0, 1 ] 9626 0.897% 0.897% ( 1, 2 ] 432928 40.333% 41.230% ######## ( 2, 3 ] 320758 29.883% 71.112% ###### ( 3, 4 ] 120319 11.209% 82.321% ## ( 4, 6 ] 124530 11.602% 93.923% ## ( 6, 10 ] 30882 2.877% 96.800% # ( 10, 15 ] 6811 0.635% 97.435% ( 15, 22 ] 983 0.092% 97.526% ( 22, 34 ] 160 0.015% 97.541% ( 34, 51 ] 335 0.031% 97.572% ( 51, 76 ] 252 0.023% 97.596% ( 76, 110 ] 82 0.008% 97.603% ( 110, 170 ] 1183 0.110% 97.714% ( 170, 250 ] 4724 0.440% 98.154% ( 250, 380 ] 5323 0.496% 98.650% ( 380, 580 ] 6101 0.568% 99.218% ( 580, 870 ] 4369 0.407% 99.625% ( 870, 1300 ] 1950 0.182% 99.807% ( 1300, 1900 ] 886 0.083% 99.889% ( 1900, 2900 ] 1183 0.110% 99.999% ( 2900, 4400 ] 1356 0.126% 100.126% ( 4400, 6600 ] 353 0.033% 100.159% ( 6600, 9900 ] 119 0.011% 100.170% ( 9900, 14000 ] 34 0.003% 100.173% ( 14000, 22000 ] 40 0.004% 100.177% ( 22000, 33000 ] 23 0.002% 100.179% ( 33000, 50000 ] 13 0.001% 100.180% ( 50000, 75000 ] 2 0.000% 100.180% ** Level 5 read latency histogram (micros): Count: 18823 Average: 788.5133 StdDev: 1650.23 Min: 99 Median: 445.8496 Max: 81641 Percentiles: P50: 445.85 P75: 755.98 P99: 5324.97 P99.9: 20671.53 P99.99: 67647.50 ------------------------------------------------------ ( 76, 110 ] 25 0.133% 0.133% ( 110, 170 ] 865 4.595% 4.728% # ( 170, 250 ] 3427 18.206% 22.935% #### ( 250, 380 ] 3711 19.715% 42.650% #### ( 380, 580 ] 4202 22.324% 64.974% #### ( 580, 870 ] 3110 16.522% 81.496% ### ( 870, 1300 ] 1316 6.991% 88.487% # ( 1300, 1900 ] 499 2.651% 91.139% # ( 1900, 2900 ] 617 3.278% 94.416% # ( 2900, 4400 ] 777 4.128% 98.544% # ( 4400, 6600 ] 204 1.084% 99.628% ( 6600, 9900 ] 32 0.170% 99.798% ( 9900, 14000 ] 5 0.027% 99.825% ( 14000, 22000 ] 17 0.090% 99.915% ( 22000, 33000 ] 7 0.037% 99.952% ( 33000, 50000 ] 5 0.027% 99.979% ( 50000, 75000 ] 3 0.016% 99.995% ( 75000, 110000 ] 1 0.005% 100.000% ** DB Stats ** Uptime(secs): 11.4 total, 4.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 172.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.505 H:M:S, 22.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 217.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.502 H:M:S, 11.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/10-05:36:19 ... thread 0: (1000000,3000000) ops and (263520.1,198805.6) ops/second in (3.794777,15.090116) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 2.81 GB 200.4 2.1 0.0 2.1 4.9 2.8 0.0 1.7 89.1 209.2 24.00 17.18 50 0.480 2171K 10K 0.0 0.0 L1 1/1 61.93 MB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.2 94.4 93.9 2.83 1.39 1 2.835 271K 1455 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 1.6 105.3 104.9 3.16 1.74 2 1.581 338K 1456 0.0 0.0 L3 18/0 991.82 MB 1.0 3.4 2.0 1.4 3.3 1.9 0.1 1.7 118.1 114.6 29.45 17.15 12 2.454 2770K 14K 0.0 0.0 L4 146/0 9.60 GB 1.0 6.9 2.5 4.4 6.1 1.8 0.6 2.4 143.4 127.0 49.55 32.44 26 1.906 1445K 0 0.0 0.0 L5 151/0 11.87 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 334/10 25.32 GB 0.0 13.0 4.9 8.1 14.9 6.9 3.3 5.3 122.2 140.2 109.00 69.90 91 1.198 6998K 28K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.0 4.9 8.1 14.9 6.9 3.3 5.3 122.2 140.2 109.00 69.90 91 1.198 6998K 28K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.0 4.9 8.1 12.1 4.0 0.0 0.0 140.2 130.4 95.05 61.52 49 1.940 6998K 28K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 207.5 13.95 8.38 42 0.332 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.2 total, 15.1 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.93 GB write, 1007.23 MB/s write, 13.01 GB read, 877.92 MB/s read, 109.0 seconds Interval compaction: 14.93 GB write, 1012.67 MB/s write, 13.01 GB read, 882.66 MB/s read, 109.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 14, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 663219 Average: 27.3985 StdDev: 231.78 Min: 1 Median: 1.7709 Max: 38987 Percentiles: P50: 1.77 P75: 2.70 P99: 492.38 P99.9: 2225.81 P99.99: 3856.56 ------------------------------------------------------ [ 0, 1 ] 63973 9.646% 9.646% ## ( 1, 2 ] 347156 52.344% 61.990% ########## ( 2, 3 ] 122676 18.497% 80.487% #### ( 3, 4 ] 40869 6.162% 86.649% # ( 4, 6 ] 35905 5.414% 92.063% # ( 6, 10 ] 8540 1.288% 93.351% ( 10, 15 ] 1824 0.275% 93.626% ( 15, 22 ] 273 0.041% 93.667% ( 22, 34 ] 40 0.006% 93.673% ( 34, 51 ] 38 0.006% 93.679% ( 51, 76 ] 17 0.003% 93.681% ( 76, 110 ] 278 0.042% 93.723% ( 110, 170 ] 6954 1.049% 94.772% ( 170, 250 ] 18048 2.721% 97.493% # ( 250, 380 ] 7362 1.110% 98.603% ( 380, 580 ] 4689 0.707% 99.310% ( 580, 870 ] 2511 0.379% 99.688% ( 870, 1300 ] 904 0.136% 99.825% ( 1300, 1900 ] 346 0.052% 99.877% ( 1900, 2900 ] 472 0.071% 99.948% ( 2900, 4400 ] 437 0.066% 100.014% ( 4400, 6600 ] 109 0.016% 100.030% ( 6600, 9900 ] 25 0.004% 100.034% ( 9900, 14000 ] 11 0.002% 100.036% ( 14000, 22000 ] 14 0.002% 100.038% ( 22000, 33000 ] 10 0.002% 100.040% ( 33000, 50000 ] 3 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 66328 Average: 20.1178 StdDev: 304.04 Min: 1 Median: 2.3165 Max: 33788 Percentiles: P50: 2.32 P75: 3.29 P99: 255.43 P99.9: 3748.20 P99.99: 6902.94 ------------------------------------------------------ [ 0, 1 ] 333 0.502% 0.502% ( 1, 2 ] 26157 39.436% 39.938% ######## ( 2, 3 ] 21088 31.794% 71.731% ###### ( 3, 4 ] 7508 11.320% 83.051% ## ( 4, 6 ] 7800 11.760% 94.811% ## ( 6, 10 ] 1957 2.950% 97.761% # ( 10, 15 ] 395 0.596% 98.357% ( 15, 22 ] 42 0.063% 98.420% ( 22, 34 ] 13 0.020% 98.440% ( 34, 51 ] 27 0.041% 98.480% ( 51, 76 ] 10 0.015% 98.495% ( 76, 110 ] 8 0.012% 98.507% ( 110, 170 ] 102 0.154% 98.661% ( 170, 250 ] 219 0.330% 98.991% ( 250, 380 ] 137 0.207% 99.198% ( 380, 580 ] 142 0.214% 99.412% ( 580, 870 ] 124 0.187% 99.599% ( 870, 1300 ] 52 0.078% 99.677% ( 1300, 1900 ] 35 0.053% 99.730% ( 1900, 2900 ] 68 0.103% 99.833% ( 2900, 4400 ] 79 0.119% 99.952% ( 4400, 6600 ] 25 0.038% 99.989% ( 6600, 9900 ] 4 0.006% 99.995% ( 9900, 14000 ] 2 0.003% 99.998% ( 14000, 22000 ] 3 0.005% 100.003% ( 22000, 33000 ] 2 0.003% 100.006% ( 33000, 50000 ] 1 0.002% 100.008% ** Level 2 read latency histogram (micros): Count: 482440 Average: 16.3671 StdDev: 270.67 Min: 1 Median: 2.2280 Max: 48460 Percentiles: P50: 2.23 P75: 3.21 P99: 15.10 P99.9: 1834.02 P99.99: 2921.16 ------------------------------------------------------ [ 0, 1 ] 5451 1.130% 1.130% ( 1, 2 ] 203390 42.159% 43.288% ######## ( 2, 3 ] 142040 29.442% 72.730% ###### ( 3, 4 ] 51794 10.736% 83.466% ## ( 4, 6 ] 56491 11.709% 95.176% ## ( 6, 10 ] 14379 2.980% 98.156% # ( 10, 15 ] 4061 0.842% 98.998% ( 15, 22 ] 689 0.143% 99.141% ( 22, 34 ] 98 0.020% 99.161% ( 34, 51 ] 108 0.022% 99.184% ( 51, 76 ] 80 0.017% 99.200% ( 76, 110 ] 29 0.006% 99.206% ( 110, 170 ] 199 0.041% 99.247% ( 170, 250 ] 525 0.109% 99.356% ( 250, 380 ] 524 0.109% 99.465% ( 380, 580 ] 788 0.163% 99.628% ( 580, 870 ] 655 0.136% 99.764% ( 870, 1300 ] 394 0.082% 99.846% ( 1300, 1900 ] 295 0.061% 99.907% ( 1900, 2900 ] 396 0.082% 99.989% ( 2900, 4400 ] 408 0.085% 100.073% ( 4400, 6600 ] 158 0.033% 100.106% ( 6600, 9900 ] 50 0.010% 100.116% ( 9900, 14000 ] 9 0.002% 100.118% ( 14000, 22000 ] 13 0.003% 100.121% ( 22000, 33000 ] 8 0.002% 100.123% ( 33000, 50000 ] 5 0.001% 100.124% ** Level 3 read latency histogram (micros): Count: 941091 Average: 15.8921 StdDev: 234.82 Min: 1 Median: 2.2749 Max: 56006 Percentiles: P50: 2.27 P75: 3.21 P99: 204.79 P99.9: 1183.21 P99.99: 2190.57 ------------------------------------------------------ [ 0, 1 ] 8457 0.899% 0.899% ( 1, 2 ] 381040 40.489% 41.388% ######## ( 2, 3 ] 294829 31.328% 72.716% ###### ( 3, 4 ] 101279 10.762% 83.478% ## ( 4, 6 ] 108934 11.575% 95.053% ## ( 6, 10 ] 27190 2.889% 97.943% # ( 10, 15 ] 5926 0.630% 98.572% ( 15, 22 ] 839 0.089% 98.661% ( 22, 34 ] 116 0.012% 98.674% ( 34, 51 ] 257 0.027% 98.701% ( 51, 76 ] 179 0.019% 98.720% ( 76, 110 ] 91 0.010% 98.730% ( 110, 170 ] 1198 0.127% 98.857% ( 170, 250 ] 3093 0.329% 99.186% ( 250, 380 ] 2115 0.225% 99.410% ( 380, 580 ] 2288 0.243% 99.654% ( 580, 870 ] 1726 0.183% 99.837% ( 870, 1300 ] 814 0.086% 99.923% ( 1300, 1900 ] 453 0.048% 99.972% ( 1900, 2900 ] 595 0.063% 100.035% ( 2900, 4400 ] 771 0.082% 100.117% ( 4400, 6600 ] 201 0.021% 100.138% ( 6600, 9900 ] 71 0.008% 100.146% ( 9900, 14000 ] 16 0.002% 100.147% ( 14000, 22000 ] 15 0.002% 100.149% ( 22000, 33000 ] 11 0.001% 100.150% ( 33000, 50000 ] 5 0.001% 100.151% ( 50000, 75000 ] 1 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 1179656 Average: 28.7301 StdDev: 304.84 Min: 0 Median: 2.2833 Max: 54466 Percentiles: P50: 2.28 P75: 3.41 P99: 490.17 P99.9: 1878.01 P99.99: 2766.19 ------------------------------------------------------ [ 0, 1 ] 13426 1.138% 1.138% ( 1, 2 ] 480095 40.698% 41.836% ######## ( 2, 3 ] 339948 28.818% 70.654% ###### ( 3, 4 ] 125187 10.612% 81.266% ## ( 4, 6 ] 128246 10.871% 92.137% ## ( 6, 10 ] 32604 2.764% 94.901% # ( 10, 15 ] 7130 0.604% 95.505% ( 15, 22 ] 1025 0.087% 95.592% ( 22, 34 ] 165 0.014% 95.606% ( 34, 51 ] 335 0.028% 95.635% ( 51, 76 ] 254 0.022% 95.656% ( 76, 110 ] 344 0.029% 95.685% ( 110, 170 ] 7573 0.642% 96.327% ( 170, 250 ] 18790 1.593% 97.920% ( 250, 380 ] 8780 0.744% 98.665% ( 380, 580 ] 7184 0.609% 99.274% ( 580, 870 ] 4563 0.387% 99.660% ( 870, 1300 ] 1969 0.167% 99.827% ( 1300, 1900 ] 891 0.076% 99.903% ( 1900, 2900 ] 1188 0.101% 100.003% ( 2900, 4400 ] 1359 0.115% 100.119% ( 4400, 6600 ] 353 0.030% 100.149% ( 6600, 9900 ] 123 0.010% 100.159% ( 9900, 14000 ] 35 0.003% 100.162% ( 14000, 22000 ] 43 0.004% 100.166% ( 22000, 33000 ] 23 0.002% 100.168% ( 33000, 50000 ] 13 0.001% 100.169% ( 50000, 75000 ] 2 0.000% 100.169% ** Level 5 read latency histogram (micros): Count: 37611 Average: 503.8141 StdDev: 1206.52 Min: 92 Median: 245.4315 Max: 81641 Percentiles: P50: 245.43 P75: 475.11 P99: 4205.56 P99.9: 11038.98 P99.99: 51990.83 ------------------------------------------------------ ( 76, 110 ] 229 0.609% 0.609% ( 110, 170 ] 5574 14.820% 15.429% ### ( 170, 250 ] 13790 36.665% 52.094% ####### ( 250, 380 ] 6230 16.564% 68.658% ### ( 380, 580 ] 5016 13.337% 81.995% ### ( 580, 870 ] 3254 8.652% 90.646% ## ( 870, 1300 ] 1336 3.552% 94.199% # ( 1300, 1900 ] 506 1.345% 95.544% ( 1900, 2900 ] 621 1.651% 97.195% ( 2900, 4400 ] 780 2.074% 99.269% ( 4400, 6600 ] 204 0.542% 99.811% ( 6600, 9900 ] 32 0.085% 99.896% ( 9900, 14000 ] 5 0.013% 99.910% ( 14000, 22000 ] 18 0.048% 99.957% ( 22000, 33000 ] 7 0.019% 99.976% ( 33000, 50000 ] 5 0.013% 99.989% ( 50000, 75000 ] 3 0.008% 99.997% ( 75000, 110000 ] 1 0.003% 100.000% ** DB Stats ** Uptime(secs): 15.2 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 194.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.531 H:M:S, 16.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 259.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.025 H:M:S, 0.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 421.503 micros/op 9453 ops/sec 20.203 seconds 190996 operations; 9.2 MB/s (46999 of 46999 found) Microseconds per read: Count: 190996 Average: 421.5192 StdDev: 1268.82 Min: 2 Median: 240.8744 Max: 142017 Percentiles: P50: 240.87 P75: 382.12 P99: 3777.77 P99.9: 17641.60 P99.99: 46387.78 ------------------------------------------------------ ( 1, 2 ] 6 0.003% 0.003% ( 2, 3 ] 49 0.026% 0.029% ( 3, 4 ] 79 0.041% 0.070% ( 4, 6 ] 220 0.115% 0.185% ( 6, 10 ] 309 0.162% 0.347% ( 10, 15 ] 1480 0.775% 1.122% ( 15, 22 ] 3025 1.584% 2.706% ( 22, 34 ] 4123 2.159% 4.864% ( 34, 51 ] 1762 0.923% 5.787% ( 51, 76 ] 314 0.164% 5.951% ( 76, 110 ] 91 0.048% 5.999% ( 110, 170 ] 13924 7.290% 13.289% # ( 170, 250 ] 79144 41.438% 54.727% ######## ( 250, 380 ] 38456 20.134% 74.861% #### ( 380, 580 ] 24997 13.088% 87.949% ### ( 580, 870 ] 12266 6.422% 94.371% # ( 870, 1300 ] 4611 2.414% 96.785% ( 1300, 1900 ] 1605 0.840% 97.626% ( 1900, 2900 ] 1450 0.759% 98.385% ( 2900, 4400 ] 2008 1.051% 99.436% ( 4400, 6600 ] 535 0.280% 99.716% ( 6600, 9900 ] 193 0.101% 99.817% ( 9900, 14000 ] 92 0.048% 99.865% ( 14000, 22000 ] 145 0.076% 99.941% ( 22000, 33000 ] 74 0.039% 99.980% ( 33000, 50000 ] 24 0.013% 99.993% ( 50000, 75000 ] 9 0.005% 99.997% ( 75000, 110000 ] 1 0.001% 99.998% ( 110000, 170000 ] 4 0.002% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3056135 rocksdb.bloom.filter.full.positive COUNT : 219977 rocksdb.bloom.filter.full.true.positive COUNT : 190106 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 890 rocksdb.memtable.miss COUNT : 190106 rocksdb.l0.hit COUNT : 22393 rocksdb.l1.hit COUNT : 585 rocksdb.l2andup.hit COUNT : 167128 rocksdb.compaction.key.drop.new COUNT : 954971 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3797729 rocksdb.number.keys.read COUNT : 190996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3919256328 rocksdb.bytes.read COUNT : 190996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 529 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4630175 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 15312564167 rocksdb.compact.write.bytes COUNT : 14326546270 rocksdb.flush.write.bytes COUNT : 3825487663 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 27 rocksdb.number.superversion_acquires COUNT : 740 rocksdb.number.superversion_releases COUNT : 708 rocksdb.number.superversion_cleanups COUNT : 180 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 63 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3800476672 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6819840 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 15700497106 rocksdb.non.last.level.read.count COUNT : 3765562 rocksdb.block.checksum.compute.count COUNT : 3932802 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 240.207492 P95 : 980.905062 P99 : 3777.332006 P100 : 142015.000000 COUNT : 190996 SUM : 80346225 rocksdb.db.write.micros P50 : 1.610267 P95 : 5.130708 P99 : 7.726759 P100 : 585670.000000 COUNT : 3797729 SUM : 15310150 rocksdb.compaction.times.micros P50 : 1873076.923077 P95 : 2872916.666667 P99 : 3919234.000000 P100 : 3919234.000000 COUNT : 53 SUM : 98926408 rocksdb.compaction.times.cpu_micros P50 : 1148260.869565 P95 : 2237500.000000 P99 : 2731782.000000 P100 : 2731782.000000 COUNT : 53 SUM : 65344324 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1026.363636 P95 : 5830.000000 P99 : 7645.000000 P100 : 7645.000000 COUNT : 54 SUM : 81308 rocksdb.compaction.outfile.sync.micros P50 : 1710.526316 P95 : 9240.000000 P99 : 77800.000000 P100 : 102394.000000 COUNT : 184 SUM : 816727 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 199.090909 P95 : 2166.666667 P99 : 4280.000000 P100 : 5466.000000 COUNT : 124 SUM : 55463 rocksdb.table.open.io.micros P50 : 5633.783784 P95 : 20008.695652 P99 : 32681.000000 P100 : 135063.000000 COUNT : 529 SUM : 3924810 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.430132 P95 : 9.773323 P99 : 217.981337 P100 : 49031.000000 COUNT : 3709611 SUM : 58219528 rocksdb.read.block.get.micros P50 : 208.576430 P95 : 823.957251 P99 : 3391.439394 P100 : 81725.000000 COUNT : 222943 SUM : 72321786 rocksdb.write.raw.block.micros P50 : 0.539199 P95 : 1.475110 P99 : 4.602697 P100 : 78476.000000 COUNT : 4405043 SUM : 16617429 rocksdb.numfiles.in.singlecompaction P50 : 3.142857 P95 : 5.680000 P99 : 8.000000 P100 : 8.000000 COUNT : 72 SUM : 255 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566918 P95 : 1140.894816 P99 : 2011.420118 P100 : 585431.000000 COUNT : 15817 SUM : 4631894 rocksdb.sst.read.micros P50 : 2.123848 P95 : 177.620854 P99 : 509.451483 P100 : 81641.000000 COUNT : 3766045 SUM : 117253754 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 190996 SUM : 190996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3797729 SUM : 3919256328 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 233529.411765 P95 : 761400.000000 P99 : 887121.000000 P100 : 887121.000000 COUNT : 54 SUM : 16388991 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 195 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0