[2024-12-05 21:43:36.143830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-12-05 21:43:36.144000] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid882743 ] Set seed to 1733431416140262 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-05 21:43:36.229044] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-05 21:43:36.268786] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-05 21:43:36.268834] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 882743' to capture a snapshot of events at runtime. [2024-12-05 21:43:36.268846] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid882743 for offline analysis/debug. [2024-12-05 21:43:36.268885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Dec 5 21:43:40 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/05-21:43:47 ... thread 0: (1000000,1000000) ops and (141911.8,141911.8) ops/second in (7.046630,7.046630) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.40 GB 50.4 0.3 0.0 0.3 1.2 0.9 0.0 1.4 39.3 149.4 8.01 3.95 12 0.668 319K 365 0.0 0.0 L1 8/8 940.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 52.34 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 886.02 MB 0.9 0.5 0.3 0.2 0.5 0.2 0.0 1.9 107.9 106.7 4.63 2.46 2 2.315 402K 3335 0.0 0.0 L4 168/0 9.60 GB 1.0 4.5 3.2 1.3 4.5 3.2 0.0 1.4 103.6 102.9 44.54 22.51 29 1.536 905K 0 0.0 0.0 L5 1116/0 91.72 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/18 105.55 GB 0.0 5.3 3.5 1.8 6.1 4.3 3.6 7.1 94.9 109.7 57.18 28.92 43 1.330 1626K 3700 0.0 0.0 Int 0/0 0.00 KB 0.0 5.3 3.5 1.8 6.1 4.3 3.6 7.1 94.9 109.7 57.18 28.92 43 1.330 1626K 3700 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.3 3.5 1.8 5.3 3.4 0.0 0.0 106.0 105.3 51.19 26.23 32 1.600 1626K 3700 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 147.3 5.99 2.68 11 0.544 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.2 total, 7.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.13 GB write, 873.03 MB/s write, 5.30 GB read, 755.34 MB/s read, 57.2 seconds Interval compaction: 6.13 GB write, 890.06 MB/s write, 5.30 GB read, 770.08 MB/s read, 57.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 24, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 355206 Average: 12.0424 StdDev: 183.37 Min: 1 Median: 1.8387 Max: 50744 Percentiles: P50: 1.84 P75: 2.85 P99: 131.51 P99.9: 1812.40 P99.99: 3756.36 ------------------------------------------------------ [ 0, 1 ] 25315 7.127% 7.127% # ( 1, 2 ] 181587 51.122% 58.248% ########## ( 2, 3 ] 69746 19.635% 77.884% #### ( 3, 4 ] 29949 8.431% 86.315% ## ( 4, 6 ] 33580 9.454% 95.769% ## ( 6, 10 ] 8663 2.439% 98.208% ( 10, 15 ] 1938 0.546% 98.753% ( 15, 22 ] 253 0.071% 98.825% ( 22, 34 ] 32 0.009% 98.834% ( 34, 51 ] 14 0.004% 98.838% ( 51, 76 ] 11 0.003% 98.841% ( 76, 110 ] 208 0.059% 98.899% ( 110, 170 ] 1004 0.283% 99.182% ( 170, 250 ] 691 0.195% 99.376% ( 250, 380 ] 438 0.123% 99.500% ( 380, 580 ] 485 0.137% 99.636% ( 580, 870 ] 398 0.112% 99.748% ( 870, 1300 ] 329 0.093% 99.841% ( 1300, 1900 ] 248 0.070% 99.911% ( 1900, 2900 ] 183 0.052% 99.962% ( 2900, 4400 ] 176 0.050% 100.012% ( 4400, 6600 ] 48 0.014% 100.025% ( 6600, 9900 ] 5 0.001% 100.027% ( 9900, 14000 ] 5 0.001% 100.028% ( 14000, 22000 ] 6 0.002% 100.030% ( 22000, 33000 ] 1 0.000% 100.030% ( 50000, 75000 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 214 Average: 948.7430 StdDev: 1592.93 Min: 89 Median: 302.0000 Max: 8017 Percentiles: P50: 302.00 P75: 853.27 P99: 8017.00 P99.9: 8017.00 P99.99: 8017.00 ------------------------------------------------------ ( 76, 110 ] 8 3.738% 3.738% # ( 110, 170 ] 55 25.701% 29.439% ##### ( 170, 250 ] 36 16.822% 46.262% ### ( 250, 380 ] 20 9.346% 55.607% ## ( 380, 580 ] 17 7.944% 63.551% ## ( 580, 870 ] 26 12.150% 75.701% ## ( 870, 1300 ] 14 6.542% 82.243% # ( 1300, 1900 ] 10 4.673% 86.916% # ( 1900, 2900 ] 8 3.738% 90.654% # ( 2900, 4400 ] 9 4.206% 94.860% # ( 4400, 6600 ] 3 1.402% 96.262% ( 6600, 9900 ] 8 3.738% 100.000% # ** Level 2 read latency histogram (micros): Count: 65443 Average: 15.0106 StdDev: 317.55 Min: 1 Median: 1.8796 Max: 39739 Percentiles: P50: 1.88 P75: 3.00 P99: 12.20 P99.9: 3045.44 P99.99: 18455.70 ------------------------------------------------------ [ 0, 1 ] 3826 5.846% 5.846% # ( 1, 2 ] 32850 50.196% 56.043% ########## ( 2, 3 ] 12459 19.038% 75.081% #### ( 3, 4 ] 6347 9.699% 84.779% ## ( 4, 6 ] 7215 11.025% 95.804% ## ( 6, 10 ] 1911 2.920% 98.724% # ( 10, 15 ] 410 0.626% 99.351% ( 15, 22 ] 56 0.086% 99.436% ( 22, 34 ] 14 0.021% 99.458% ( 34, 51 ] 4 0.006% 99.464% ( 51, 76 ] 3 0.005% 99.468% ( 76, 110 ] 3 0.005% 99.473% ( 110, 170 ] 4 0.006% 99.479% ( 170, 250 ] 5 0.008% 99.487% ( 250, 380 ] 12 0.018% 99.505% ( 380, 580 ] 39 0.060% 99.565% ( 580, 870 ] 61 0.093% 99.658% ( 870, 1300 ] 58 0.089% 99.746% ( 1300, 1900 ] 50 0.076% 99.823% ( 1900, 2900 ] 46 0.070% 99.893% ( 2900, 4400 ] 47 0.072% 99.965% ( 4400, 6600 ] 5 0.008% 99.972% ( 6600, 9900 ] 6 0.009% 99.982% ( 9900, 14000 ] 1 0.002% 99.983% ( 14000, 22000 ] 8 0.012% 99.995% ( 22000, 33000 ] 2 0.003% 99.998% ( 33000, 50000 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 656489 Average: 14.5316 StdDev: 241.94 Min: 1 Median: 1.8863 Max: 38974 Percentiles: P50: 1.89 P75: 2.98 P99: 11.99 P99.9: 1276.17 P99.99: 1770.93 ------------------------------------------------------ [ 0, 1 ] 28529 4.346% 4.346% # ( 1, 2 ] 338148 51.509% 55.854% ########## ( 2, 3 ] 128384 19.556% 75.410% #### ( 3, 4 ] 66845 10.182% 85.593% ## ( 4, 6 ] 69602 10.602% 96.195% ## ( 6, 10 ] 16725 2.548% 98.742% # ( 10, 15 ] 4246 0.647% 99.389% ( 15, 22 ] 572 0.087% 99.476% ( 22, 34 ] 64 0.010% 99.486% ( 34, 51 ] 32 0.005% 99.491% ( 51, 76 ] 31 0.005% 99.496% ( 76, 110 ] 44 0.007% 99.502% ( 110, 170 ] 107 0.016% 99.519% ( 170, 250 ] 140 0.021% 99.540% ( 250, 380 ] 272 0.041% 99.581% ( 380, 580 ] 497 0.076% 99.657% ( 580, 870 ] 768 0.117% 99.774% ( 870, 1300 ] 875 0.133% 99.907% ( 1300, 1900 ] 691 0.105% 100.013% ( 1900, 2900 ] 558 0.085% 100.098% ( 2900, 4400 ] 457 0.070% 100.167% ( 4400, 6600 ] 118 0.018% 100.185% ( 6600, 9900 ] 31 0.005% 100.190% ( 9900, 14000 ] 4 0.001% 100.191% ( 14000, 22000 ] 24 0.004% 100.194% ( 22000, 33000 ] 16 0.002% 100.197% ( 33000, 50000 ] 3 0.000% 100.197% ** Level 4 read latency histogram (micros): Count: 316625 Average: 28.7165 StdDev: 370.93 Min: 1 Median: 1.8567 Max: 54849 Percentiles: P50: 1.86 P75: 2.94 P99: 689.12 P99.9: 3108.84 P99.99: 4062.96 ------------------------------------------------------ [ 0, 1 ] 16425 5.188% 5.188% # ( 1, 2 ] 165630 52.311% 57.499% ########## ( 2, 3 ] 59191 18.694% 76.193% #### ( 3, 4 ] 31517 9.954% 86.147% ## ( 4, 6 ] 29153 9.207% 95.354% ## ( 6, 10 ] 6969 2.201% 97.555% ( 10, 15 ] 1532 0.484% 98.039% ( 15, 22 ] 190 0.060% 98.099% ( 22, 34 ] 29 0.009% 98.108% ( 34, 51 ] 20 0.006% 98.115% ( 51, 76 ] 13 0.004% 98.119% ( 76, 110 ] 137 0.043% 98.162% ( 110, 170 ] 556 0.176% 98.338% ( 170, 250 ] 536 0.169% 98.507% ( 250, 380 ] 477 0.151% 98.658% ( 380, 580 ] 718 0.227% 98.884% ( 580, 870 ] 972 0.307% 99.191% ( 870, 1300 ] 962 0.304% 99.495% ( 1300, 1900 ] 695 0.220% 99.715% ( 1900, 2900 ] 524 0.165% 99.880% ( 2900, 4400 ] 448 0.141% 100.022% ( 4400, 6600 ] 123 0.039% 100.061% ( 6600, 9900 ] 28 0.009% 100.069% ( 9900, 14000 ] 11 0.003% 100.073% ( 14000, 22000 ] 18 0.006% 100.079% ( 22000, 33000 ] 17 0.005% 100.084% ( 33000, 50000 ] 4 0.001% 100.085% ( 50000, 75000 ] 1 0.000% 100.086% ** Level 5 read latency histogram (micros): Count: 19549 Average: 1025.0928 StdDev: 1915.12 Min: 77 Median: 406.0524 Max: 78439 Percentiles: P50: 406.05 P75: 1161.01 P99: 6396.26 P99.9: 24372.56 P99.99: 47294.45 ------------------------------------------------------ ( 76, 110 ] 930 4.757% 4.757% # ( 110, 170 ] 3818 19.530% 24.288% #### ( 170, 250 ] 2684 13.730% 38.017% ### ( 250, 380 ] 2064 10.558% 48.575% ## ( 380, 580 ] 2138 10.937% 59.512% ## ( 580, 870 ] 1949 9.970% 69.482% ## ( 870, 1300 ] 1594 8.154% 77.636% ## ( 1300, 1900 ] 1269 6.491% 84.127% # ( 1900, 2900 ] 1119 5.724% 89.851% # ( 2900, 4400 ] 1284 6.568% 96.419% # ( 4400, 6600 ] 556 2.844% 99.263% # ( 6600, 9900 ] 103 0.527% 99.790% ( 9900, 14000 ] 12 0.061% 99.852% ( 14000, 22000 ] 6 0.031% 99.882% ( 22000, 33000 ] 16 0.082% 99.964% ( 33000, 50000 ] 6 0.031% 99.995% ( 50000, 75000 ] 3 0.015% 100.010% ( 75000, 110000 ] 1 0.005% 100.015% ** DB Stats ** Uptime(secs): 7.2 total, 7.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 136.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.224 H:M:S, 44.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 139.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.224 H:M:S, 45.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/05-21:43:50 ... thread 0: (1000000,2000000) ops and (297859.3,192235.2) ops/second in (3.357290,10.403920) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.38 GB 163.6 1.4 0.0 1.4 3.3 1.8 0.0 1.8 93.5 215.3 15.50 10.95 32 0.484 1471K 1669 0.0 0.0 L1 8/8 940.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 52.34 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 886.02 MB 0.9 0.5 0.3 0.2 0.5 0.2 0.0 1.9 107.9 106.7 4.63 2.46 2 2.315 402K 3335 0.0 0.0 L4 168/0 9.60 GB 1.0 4.5 3.2 1.3 4.5 3.2 0.0 1.4 103.6 102.9 44.54 22.51 29 1.536 905K 0 0.0 0.0 L5 1116/0 91.72 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1327/18 106.54 GB 0.0 6.4 3.5 2.9 8.2 5.3 3.6 4.5 101.5 130.1 64.67 35.92 63 1.026 2778K 5004 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 3.5 2.9 8.2 5.3 3.6 4.5 101.5 130.1 64.67 35.92 63 1.026 2778K 5004 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 3.5 2.9 6.4 3.4 0.0 0.0 118.2 117.5 55.51 30.47 36 1.542 2778K 5004 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 206.4 9.16 5.45 27 0.339 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.5 total, 10.4 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.22 GB write, 798.07 MB/s write, 6.41 GB read, 622.38 MB/s read, 64.7 seconds Interval compaction: 8.22 GB write, 808.61 MB/s write, 6.41 GB read, 630.61 MB/s read, 64.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 24, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 691944 Average: 11.8197 StdDev: 137.45 Min: 0 Median: 1.6724 Max: 50744 Percentiles: P50: 1.67 P75: 2.53 P99: 214.43 P99.9: 828.74 P99.99: 1534.84 ------------------------------------------------------ [ 0, 1 ] 102589 14.826% 14.826% ### ( 1, 2 ] 361956 52.310% 67.136% ########## ( 2, 3 ] 102563 14.822% 81.959% ### ( 3, 4 ] 46442 6.712% 88.670% # ( 4, 6 ] 45302 6.547% 95.218% # ( 6, 10 ] 11574 1.673% 96.890% ( 10, 15 ] 2603 0.376% 97.266% ( 15, 22 ] 540 0.078% 97.344% ( 22, 34 ] 74 0.011% 97.355% ( 34, 51 ] 22 0.003% 97.358% ( 51, 76 ] 15 0.002% 97.360% ( 76, 110 ] 1831 0.265% 97.625% ( 110, 170 ] 7240 1.046% 98.671% ( 170, 250 ] 4094 0.592% 99.263% ( 250, 380 ] 2001 0.289% 99.552% ( 380, 580 ] 1701 0.246% 99.798% ( 580, 870 ] 822 0.119% 99.917% ( 870, 1300 ] 406 0.059% 99.976% ( 1300, 1900 ] 255 0.037% 100.012% ( 1900, 2900 ] 194 0.028% 100.040% ( 2900, 4400 ] 186 0.027% 100.067% ( 4400, 6600 ] 48 0.007% 100.074% ( 6600, 9900 ] 5 0.001% 100.075% ( 9900, 14000 ] 5 0.001% 100.076% ( 14000, 22000 ] 6 0.001% 100.077% ( 22000, 33000 ] 1 0.000% 100.077% ( 50000, 75000 ] 1 0.000% 100.077% ** Level 1 read latency histogram (micros): Count: 710 Average: 431.2775 StdDev: 944.70 Min: 82 Median: 176.2857 Max: 8017 Percentiles: P50: 176.29 P75: 332.96 P99: 6971.25 P99.9: 8017.00 P99.99: 8017.00 ------------------------------------------------------ ( 76, 110 ] 66 9.296% 9.296% ## ( 110, 170 ] 278 39.155% 48.451% ######## ( 170, 250 ] 140 19.718% 68.169% #### ( 250, 380 ] 76 10.704% 78.873% ## ( 380, 580 ] 59 8.310% 87.183% ## ( 580, 870 ] 38 5.352% 92.535% # ( 870, 1300 ] 15 2.113% 94.648% ( 1300, 1900 ] 10 1.408% 96.056% ( 1900, 2900 ] 8 1.127% 97.183% ( 2900, 4400 ] 9 1.268% 98.451% ( 4400, 6600 ] 3 0.423% 98.873% ( 6600, 9900 ] 8 1.127% 100.000% ** Level 2 read latency histogram (micros): Count: 65476 Average: 15.1240 StdDev: 317.53 Min: 1 Median: 1.8801 Max: 39739 Percentiles: P50: 1.88 P75: 3.00 P99: 12.60 P99.9: 3044.38 P99.99: 18452.40 ------------------------------------------------------ [ 0, 1 ] 3826 5.843% 5.843% # ( 1, 2 ] 32850 50.171% 56.014% ########## ( 2, 3 ] 12459 19.028% 75.043% #### ( 3, 4 ] 6347 9.694% 84.736% ## ( 4, 6 ] 7215 11.019% 95.756% ## ( 6, 10 ] 1911 2.919% 98.674% # ( 10, 15 ] 410 0.626% 99.301% ( 15, 22 ] 56 0.086% 99.386% ( 22, 34 ] 14 0.021% 99.407% ( 34, 51 ] 4 0.006% 99.414% ( 51, 76 ] 3 0.005% 99.418% ( 76, 110 ] 8 0.012% 99.430% ( 110, 170 ] 16 0.024% 99.455% ( 170, 250 ] 10 0.015% 99.470% ( 250, 380 ] 17 0.026% 99.496% ( 380, 580 ] 44 0.067% 99.563% ( 580, 870 ] 62 0.095% 99.658% ( 870, 1300 ] 58 0.089% 99.746% ( 1300, 1900 ] 50 0.076% 99.823% ( 1900, 2900 ] 46 0.070% 99.893% ( 2900, 4400 ] 47 0.072% 99.965% ( 4400, 6600 ] 5 0.008% 99.973% ( 6600, 9900 ] 6 0.009% 99.982% ( 9900, 14000 ] 1 0.002% 99.983% ( 14000, 22000 ] 8 0.012% 99.995% ( 22000, 33000 ] 2 0.003% 99.998% ( 33000, 50000 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 657121 Average: 14.7170 StdDev: 241.94 Min: 1 Median: 1.8873 Max: 38974 Percentiles: P50: 1.89 P75: 2.98 P99: 12.73 P99.9: 1276.43 P99.99: 1771.06 ------------------------------------------------------ [ 0, 1 ] 28529 4.342% 4.342% # ( 1, 2 ] 338148 51.459% 55.801% ########## ( 2, 3 ] 128384 19.537% 75.338% #### ( 3, 4 ] 66845 10.172% 85.510% ## ( 4, 6 ] 69602 10.592% 96.102% ## ( 6, 10 ] 16725 2.545% 98.647% # ( 10, 15 ] 4246 0.646% 99.294% ( 15, 22 ] 572 0.087% 99.381% ( 22, 34 ] 64 0.010% 99.390% ( 34, 51 ] 32 0.005% 99.395% ( 51, 76 ] 31 0.005% 99.400% ( 76, 110 ] 124 0.019% 99.419% ( 110, 170 ] 397 0.060% 99.479% ( 170, 250 ] 273 0.042% 99.521% ( 250, 380 ] 332 0.051% 99.571% ( 380, 580 ] 549 0.084% 99.655% ( 580, 870 ] 781 0.119% 99.774% ( 870, 1300 ] 878 0.134% 99.907% ( 1300, 1900 ] 692 0.105% 100.013% ( 1900, 2900 ] 558 0.085% 100.098% ( 2900, 4400 ] 457 0.070% 100.167% ( 4400, 6600 ] 118 0.018% 100.185% ( 6600, 9900 ] 31 0.005% 100.190% ( 9900, 14000 ] 4 0.001% 100.190% ( 14000, 22000 ] 24 0.004% 100.194% ( 22000, 33000 ] 16 0.002% 100.196% ( 33000, 50000 ] 3 0.000% 100.197% ** Level 4 read latency histogram (micros): Count: 322852 Average: 31.7336 StdDev: 368.67 Min: 1 Median: 1.8751 Max: 54849 Percentiles: P50: 1.88 P75: 3.02 P99: 707.06 P99.9: 3090.92 P99.99: 4061.63 ------------------------------------------------------ [ 0, 1 ] 16426 5.088% 5.088% # ( 1, 2 ] 165702 51.324% 56.412% ########## ( 2, 3 ] 59418 18.404% 74.816% #### ( 3, 4 ] 31668 9.809% 84.625% ## ( 4, 6 ] 29428 9.115% 93.740% ## ( 6, 10 ] 7009 2.171% 95.911% ( 10, 15 ] 1543 0.478% 96.389% ( 15, 22 ] 192 0.059% 96.449% ( 22, 34 ] 29 0.009% 96.458% ( 34, 51 ] 20 0.006% 96.464% ( 51, 76 ] 14 0.004% 96.468% ( 76, 110 ] 816 0.253% 96.721% ( 110, 170 ] 2983 0.924% 97.645% ( 170, 250 ] 1766 0.547% 98.192% ( 250, 380 ] 1006 0.312% 98.503% ( 380, 580 ] 1111 0.344% 98.847% ( 580, 870 ] 1124 0.348% 99.196% ( 870, 1300 ] 990 0.307% 99.502% ( 1300, 1900 ] 700 0.217% 99.719% ( 1900, 2900 ] 527 0.163% 99.882% ( 2900, 4400 ] 449 0.139% 100.021% ( 4400, 6600 ] 123 0.038% 100.059% ( 6600, 9900 ] 28 0.009% 100.068% ( 9900, 14000 ] 11 0.003% 100.072% ( 14000, 22000 ] 18 0.006% 100.077% ( 22000, 33000 ] 17 0.005% 100.082% ( 33000, 50000 ] 4 0.001% 100.084% ( 50000, 75000 ] 1 0.000% 100.084% ** Level 5 read latency histogram (micros): Count: 60721 Average: 472.7725 StdDev: 1158.28 Min: 77 Median: 184.3497 Max: 78439 Percentiles: P50: 184.35 P75: 365.45 P99: 4755.28 P99.9: 9172.05 P99.99: 31575.43 ------------------------------------------------------ ( 76, 110 ] 5832 9.605% 9.605% ## ( 110, 170 ] 22373 36.846% 46.450% ####### ( 170, 250 ] 12017 19.791% 66.241% #### ( 250, 380 ] 5989 9.863% 76.104% ## ( 380, 580 ] 5289 8.710% 84.814% ## ( 580, 870 ] 3018 4.970% 89.784% # ( 870, 1300 ] 1790 2.948% 92.732% # ( 1300, 1900 ] 1286 2.118% 94.850% ( 1900, 2900 ] 1142 1.881% 96.731% ( 2900, 4400 ] 1288 2.121% 98.852% ( 4400, 6600 ] 556 0.916% 99.768% ( 6600, 9900 ] 103 0.170% 99.937% ( 9900, 14000 ] 12 0.020% 99.957% ( 14000, 22000 ] 6 0.010% 99.967% ( 22000, 33000 ] 16 0.026% 99.993% ( 33000, 50000 ] 6 0.010% 100.003% ( 50000, 75000 ] 3 0.005% 100.008% ( 75000, 110000 ] 1 0.002% 100.010% ** DB Stats ** Uptime(secs): 10.5 total, 3.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 186.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.224 H:M:S, 30.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 293.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/05-21:44:18 ... thread 0: (1000000,3000000) ops and (35671.0,78047.9) ops/second in (28.033997,38.437917) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/13 2.83 GB 0.0 2.6 0.0 2.6 5.5 2.8 0.0 1.9 115.0 237.9 23.56 18.46 53 0.444 2750K 2862 0.0 0.0 L1 21/21 2.43 GB 0.0 2.5 1.5 0.9 2.4 1.5 0.0 1.6 85.9 85.2 29.25 15.77 1 29.249 2551K 19K 0.0 0.0 L2 1/0 52.34 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 886.02 MB 0.9 0.5 0.3 0.2 0.5 0.2 0.0 1.9 107.9 106.7 4.63 2.46 2 2.315 402K 3335 0.0 0.0 L4 168/0 9.60 GB 1.0 4.5 3.2 1.3 4.5 3.2 0.0 1.4 103.6 102.9 44.54 22.51 29 1.536 905K 0 0.0 0.0 L5 1116/0 91.72 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/34 107.50 GB 0.0 10.1 5.0 5.1 12.9 7.8 3.6 4.5 101.3 129.2 101.97 59.19 85 1.200 6609K 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.1 5.0 5.1 12.9 7.8 3.6 4.5 101.3 129.2 101.97 59.19 85 1.200 6609K 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.1 5.0 5.1 10.0 5.0 0.0 0.0 115.3 114.6 89.64 50.98 42 2.134 6609K 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 234.9 12.34 8.21 43 0.287 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.6 total, 38.4 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.87 GB write, 341.49 MB/s write, 10.09 GB read, 267.89 MB/s read, 102.0 seconds Interval compaction: 12.87 GB write, 342.71 MB/s write, 10.09 GB read, 268.85 MB/s read, 102.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 24, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1296516 Average: 25.1239 StdDev: 116.35 Min: 0 Median: 1.7996 Max: 50744 Percentiles: P50: 1.80 P75: 3.46 P99: 247.79 P99.9: 707.00 P99.99: 1116.36 ------------------------------------------------------ [ 0, 1 ] 197480 15.232% 15.232% ### ( 1, 2 ] 563724 43.480% 58.712% ######### ( 2, 3 ] 168707 13.012% 71.724% ### ( 3, 4 ] 91411 7.051% 78.774% # ( 4, 6 ] 80767 6.230% 85.004% # ( 6, 10 ] 16914 1.305% 86.308% ( 10, 15 ] 3836 0.296% 86.604% ( 15, 22 ] 1038 0.080% 86.684% ( 22, 34 ] 150 0.012% 86.696% ( 34, 51 ] 29 0.002% 86.698% ( 51, 76 ] 70 0.005% 86.704% ( 76, 110 ] 37683 2.906% 89.610% # ( 110, 170 ] 100845 7.778% 97.388% ## ( 170, 250 ] 21490 1.658% 99.046% ( 250, 380 ] 6051 0.467% 99.512% ( 380, 580 ] 4347 0.335% 99.848% ( 580, 870 ] 1547 0.119% 99.967% ( 870, 1300 ] 519 0.040% 100.007% ( 1300, 1900 ] 292 0.023% 100.030% ( 1900, 2900 ] 263 0.020% 100.050% ( 2900, 4400 ] 227 0.018% 100.067% ( 4400, 6600 ] 48 0.004% 100.071% ( 6600, 9900 ] 5 0.000% 100.071% ( 9900, 14000 ] 5 0.000% 100.072% ( 14000, 22000 ] 6 0.000% 100.072% ( 22000, 33000 ] 1 0.000% 100.072% ( 50000, 75000 ] 1 0.000% 100.073% ** Level 1 read latency histogram (micros): Count: 294090 Average: 8.0636 StdDev: 59.58 Min: 1 Median: 2.1910 Max: 8017 Percentiles: P50: 2.19 P75: 3.45 P99: 154.43 P99.9: 428.60 P99.99: 1839.61 ------------------------------------------------------ [ 0, 1 ] 31106 10.577% 10.577% ## ( 1, 2 ] 104912 35.673% 46.250% ####### ( 2, 3 ] 57735 19.632% 65.882% #### ( 3, 4 ] 59325 20.172% 86.055% #### ( 4, 6 ] 24463 8.318% 94.373% ## ( 6, 10 ] 5346 1.818% 96.191% ( 10, 15 ] 1694 0.576% 96.767% ( 15, 22 ] 847 0.288% 97.055% ( 22, 34 ] 30 0.010% 97.065% ( 34, 51 ] 1 0.000% 97.065% ( 76, 110 ] 1814 0.617% 97.682% ( 110, 170 ] 5234 1.780% 99.462% ( 170, 250 ] 994 0.338% 99.800% ( 250, 380 ] 257 0.087% 99.887% ( 380, 580 ] 156 0.053% 99.940% ( 580, 870 ] 98 0.033% 99.973% ( 870, 1300 ] 36 0.012% 99.986% ( 1300, 1900 ] 14 0.005% 99.990% ( 1900, 2900 ] 9 0.003% 99.994% ( 2900, 4400 ] 13 0.004% 99.998% ( 4400, 6600 ] 3 0.001% 99.999% ( 6600, 9900 ] 8 0.003% 100.002% ** Level 2 read latency histogram (micros): Count: 65914 Average: 16.0404 StdDev: 316.79 Min: 1 Median: 1.8868 Max: 39739 Percentiles: P50: 1.89 P75: 3.05 P99: 119.28 P99.9: 3030.40 P99.99: 18408.60 ------------------------------------------------------ [ 0, 1 ] 3826 5.805% 5.805% # ( 1, 2 ] 32850 49.838% 55.642% ########## ( 2, 3 ] 12459 18.902% 74.544% #### ( 3, 4 ] 6347 9.629% 84.173% ## ( 4, 6 ] 7215 10.946% 95.119% ## ( 6, 10 ] 1911 2.899% 98.019% # ( 10, 15 ] 410 0.622% 98.641% ( 15, 22 ] 56 0.085% 98.726% ( 22, 34 ] 14 0.021% 98.747% ( 34, 51 ] 4 0.006% 98.753% ( 51, 76 ] 3 0.005% 98.757% ( 76, 110 ] 117 0.178% 98.935% ( 110, 170 ] 277 0.420% 99.355% ( 170, 250 ] 53 0.080% 99.436% ( 250, 380 ] 31 0.047% 99.483% ( 380, 580 ] 52 0.079% 99.562% ( 580, 870 ] 64 0.097% 99.659% ( 870, 1300 ] 58 0.088% 99.747% ( 1300, 1900 ] 51 0.077% 99.824% ( 1900, 2900 ] 46 0.070% 99.894% ( 2900, 4400 ] 47 0.071% 99.965% ( 4400, 6600 ] 5 0.008% 99.973% ( 6600, 9900 ] 6 0.009% 99.982% ( 9900, 14000 ] 1 0.002% 99.983% ( 14000, 22000 ] 8 0.012% 99.995% ( 22000, 33000 ] 2 0.003% 99.998% ( 33000, 50000 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 663764 Average: 16.0237 StdDev: 241.19 Min: 1 Median: 1.8971 Max: 38974 Percentiles: P50: 1.90 P75: 3.04 P99: 139.08 P99.9: 1274.25 P99.99: 1771.54 ------------------------------------------------------ [ 0, 1 ] 28529 4.298% 4.298% # ( 1, 2 ] 338148 50.944% 55.242% ########## ( 2, 3 ] 128384 19.342% 74.584% #### ( 3, 4 ] 66845 10.071% 84.654% ## ( 4, 6 ] 69602 10.486% 95.140% ## ( 6, 10 ] 16725 2.520% 97.660% # ( 10, 15 ] 4246 0.640% 98.300% ( 15, 22 ] 572 0.086% 98.386% ( 22, 34 ] 64 0.010% 98.396% ( 34, 51 ] 32 0.005% 98.400% ( 51, 76 ] 31 0.005% 98.405% ( 76, 110 ] 1806 0.272% 98.677% ( 110, 170 ] 4421 0.666% 99.343% ( 170, 250 ] 928 0.140% 99.483% ( 250, 380 ] 487 0.073% 99.556% ( 380, 580 ] 639 0.096% 99.653% ( 580, 870 ] 813 0.122% 99.775% ( 870, 1300 ] 881 0.133% 99.908% ( 1300, 1900 ] 693 0.104% 100.012% ( 1900, 2900 ] 559 0.084% 100.097% ( 2900, 4400 ] 457 0.069% 100.165% ( 4400, 6600 ] 118 0.018% 100.183% ( 6600, 9900 ] 31 0.005% 100.188% ( 9900, 14000 ] 4 0.001% 100.188% ( 14000, 22000 ] 24 0.004% 100.192% ( 22000, 33000 ] 16 0.002% 100.194% ( 33000, 50000 ] 3 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 396338 Average: 52.5372 StdDev: 337.09 Min: 1 Median: 2.2681 Max: 54849 Percentiles: P50: 2.27 P75: 5.59 P99: 592.38 P99.9: 2871.38 P99.99: 4037.89 ------------------------------------------------------ [ 0, 1 ] 16426 4.144% 4.144% # ( 1, 2 ] 165749 41.820% 45.965% ######## ( 2, 3 ] 59647 15.050% 61.014% ### ( 3, 4 ] 31841 8.034% 69.048% ## ( 4, 6 ] 29673 7.487% 76.535% # ( 6, 10 ] 7043 1.777% 78.312% ( 10, 15 ] 1553 0.392% 78.704% ( 15, 22 ] 193 0.049% 78.752% ( 22, 34 ] 29 0.007% 78.760% ( 34, 51 ] 20 0.005% 78.765% ( 51, 76 ] 25 0.006% 78.771% ( 76, 110 ] 18034 4.550% 83.321% # ( 110, 170 ] 47977 12.105% 95.426% ## ( 170, 250 ] 9362 2.362% 97.788% ( 250, 380 ] 2638 0.666% 98.454% ( 380, 580 ] 2106 0.531% 98.985% ( 580, 870 ] 1373 0.346% 99.332% ( 870, 1300 ] 1022 0.258% 99.589% ( 1300, 1900 ] 710 0.179% 99.769% ( 1900, 2900 ] 536 0.135% 99.904% ( 2900, 4400 ] 450 0.114% 100.017% ( 4400, 6600 ] 123 0.031% 100.048% ( 6600, 9900 ] 28 0.007% 100.056% ( 9900, 14000 ] 11 0.003% 100.058% ( 14000, 22000 ] 18 0.005% 100.063% ( 22000, 33000 ] 17 0.004% 100.067% ( 33000, 50000 ] 4 0.001% 100.068% ( 50000, 75000 ] 1 0.000% 100.068% ** Level 5 read latency histogram (micros): Count: 546674 Average: 182.1972 StdDev: 405.92 Min: 73 Median: 138.2642 Max: 78439 Percentiles: P50: 138.26 P75: 163.59 P99: 1112.31 P99.9: 4967.12 P99.99: 9141.72 ------------------------------------------------------ ( 51, 76 ] 58 0.011% 0.011% ( 76, 110 ] 120734 22.085% 22.096% #### ( 110, 170 ] 323827 59.236% 81.332% ############ ( 170, 250 ] 61595 11.267% 92.599% ## ( 250, 380 ] 16841 3.081% 95.680% # ( 380, 580 ] 12120 2.217% 97.897% ( 580, 870 ] 4881 0.893% 98.789% ( 870, 1300 ] 2043 0.374% 99.163% ( 1300, 1900 ] 1371 0.251% 99.414% ( 1900, 2900 ] 1218 0.223% 99.637% ( 2900, 4400 ] 1296 0.237% 99.874% ( 4400, 6600 ] 556 0.102% 99.975% ( 6600, 9900 ] 103 0.019% 99.994% ( 9900, 14000 ] 12 0.002% 99.997% ( 14000, 22000 ] 6 0.001% 99.998% ( 22000, 33000 ] 16 0.003% 100.001% ( 33000, 50000 ] 6 0.001% 100.002% ( 50000, 75000 ] 3 0.001% 100.002% ( 75000, 110000 ] 1 0.000% 100.002% ** DB Stats ** Uptime(secs): 38.6 total, 28.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 76.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.014 H:M:S, 70.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 35.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:23.790 H:M:S, 84.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 209.851 micros/op 19046 ops/sec 60.168 seconds 1145996 operations; 18.5 MB/s (301999 of 301999 found) Microseconds per read: Count: 1145996 Average: 209.8526 StdDev: 699.31 Min: 2 Median: 165.3197 Max: 233009 Percentiles: P50: 165.32 P75: 221.60 P99: 695.56 P99.9: 7706.91 P99.99: 27791.87 ------------------------------------------------------ ( 1, 2 ] 2 0.000% 0.000% ( 2, 3 ] 42 0.004% 0.004% ( 3, 4 ] 61 0.005% 0.009% ( 4, 6 ] 97 0.008% 0.018% ( 6, 10 ] 334 0.029% 0.047% ( 10, 15 ] 4281 0.374% 0.420% ( 15, 22 ] 6291 0.549% 0.969% ( 22, 34 ] 12379 1.080% 2.049% ( 34, 51 ] 2952 0.258% 2.307% ( 51, 76 ] 311 0.027% 2.334% ( 76, 110 ] 25565 2.231% 4.565% ( 110, 170 ] 564735 49.279% 53.844% ########## ( 170, 250 ] 375878 32.799% 86.643% ####### ( 250, 380 ] 105079 9.169% 95.812% ## ( 380, 580 ] 32662 2.850% 98.663% # ( 580, 870 ] 9704 0.847% 99.509% ( 870, 1300 ] 2446 0.213% 99.723% ( 1300, 1900 ] 761 0.066% 99.789% ( 1900, 2900 ] 592 0.052% 99.841% ( 2900, 4400 ] 477 0.042% 99.882% ( 4400, 6600 ] 147 0.013% 99.895% ( 6600, 9900 ] 161 0.014% 99.909% ( 9900, 14000 ] 324 0.028% 99.938% ( 14000, 22000 ] 523 0.046% 99.983% ( 22000, 33000 ] 147 0.013% 99.996% ( 33000, 50000 ] 33 0.003% 99.999% ( 50000, 75000 ] 6 0.001% 99.999% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 19039539 rocksdb.bloom.filter.full.positive COUNT : 1330856 rocksdb.bloom.filter.full.true.positive COUNT : 1145568 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 428 rocksdb.memtable.miss COUNT : 1145568 rocksdb.l0.hit COUNT : 38972 rocksdb.l1.hit COUNT : 21259 rocksdb.l2andup.hit COUNT : 1085337 rocksdb.compaction.key.drop.new COUNT : 84362 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3067688 rocksdb.number.keys.read COUNT : 1145996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3165854016 rocksdb.bytes.read COUNT : 1145996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1487 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 48314854 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 12246136939 rocksdb.compact.write.bytes COUNT : 12159291658 rocksdb.flush.write.bytes COUNT : 3104732607 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 570 rocksdb.number.superversion_releases COUNT : 544 rocksdb.number.superversion_cleanups COUNT : 144 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 151 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3079644160 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1154048 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 17361750579 rocksdb.non.last.level.read.count COUNT : 4052297 rocksdb.block.checksum.compute.count COUNT : 4309641 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 164.510867 P95 : 367.975401 P99 : 694.052230 P100 : 233008.000000 COUNT : 1145996 SUM : 239487677 rocksdb.db.write.micros P50 : 1.547473 P95 : 5.073851 P99 : 104.300407 P100 : 710304.000000 COUNT : 3067688 SUM : 56189655 rocksdb.compaction.times.micros P50 : 1462500.000000 P95 : 2790000.000000 P99 : 28380000.000000 P100 : 29248663.000000 COUNT : 42 SUM : 89635774 rocksdb.compaction.times.cpu_micros P50 : 897777.777778 P95 : 1707500.000000 P99 : 15768741.000000 P100 : 15768741.000000 COUNT : 42 SUM : 50977929 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 765.600000 P95 : 26400.000000 P99 : 143191.000000 P100 : 143191.000000 COUNT : 44 SUM : 270267 rocksdb.compaction.outfile.sync.micros P50 : 31777.777778 P95 : 146000.000000 P99 : 240400.000000 P100 : 407693.000000 COUNT : 136 SUM : 6003309 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 202.000000 P95 : 4455.000000 P99 : 6666.000000 P100 : 7324.000000 COUNT : 98 SUM : 114548 rocksdb.table.open.io.micros P50 : 9639.473684 P95 : 20512.307692 P99 : 28121.500000 P100 : 175021.000000 COUNT : 1487 SUM : 15119412 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.016465 P95 : 125.243808 P99 : 225.603166 P100 : 50754.000000 COUNT : 2965939 SUM : 65047835 rocksdb.read.block.get.micros P50 : 135.819890 P95 : 244.916809 P99 : 571.647989 P100 : 78529.000000 COUNT : 1342210 SUM : 200916259 rocksdb.write.raw.block.micros P50 : 0.578552 P95 : 1.805741 P99 : 4.054731 P100 : 84463.000000 COUNT : 3697145 SUM : 11476138 rocksdb.numfiles.in.singlecompaction P50 : 3.111111 P95 : 5.200000 P99 : 27.280000 P100 : 34.000000 COUNT : 56 SUM : 231 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.579472 P95 : 2205.979745 P99 : 2765.673263 P100 : 710126.000000 COUNT : 210011 SUM : 48333168 rocksdb.sst.read.micros P50 : 3.235515 P95 : 180.549942 P99 : 426.637411 P100 : 78439.000000 COUNT : 4052358 SUM : 252226912 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1145996 SUM : 1145996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3067688 SUM : 3165854016 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217567.567568 P95 : 840666.666667 P99 : 952277.000000 P100 : 952277.000000 COUNT : 44 SUM : 12556243 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 155 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0