[2024-11-27 10:34:23.909153] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-27 10:34:23.909446] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1478267 ] Set seed to 1732700063902480 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 10:34:24.022477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 10:34:24.063296] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 10:34:24.063340] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1478267' to capture a snapshot of events at runtime. [2024-11-27 10:34:24.063352] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1478267 for offline analysis/debug. [2024-11-27 10:34:24.063387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 10:34:28 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/27-10:34:31 ... thread 0: (1000000,1000000) ops and (355766.5,355766.5) ops/second in (2.810832,2.810832) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 504.04 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 354.7 2.31 2.06 12 0.192 0 0 0.0 0.0 L1 3/3 251.74 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 252.2 252.0 1.00 0.96 1 0.999 255K 182 0.0 0.0 L2 1/0 48.76 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 16/0 692.48 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.1 210.1 0.30 0.25 1 0.298 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/8 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.2 1.5 105.2 307.5 4.05 3.70 15 0.270 432K 216 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.2 1.5 105.2 307.5 4.05 3.70 15 0.270 432K 216 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 245.0 244.9 1.74 1.63 3 0.579 432K 216 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 354.7 2.31 2.06 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 414.01 MB/s write, 0.42 GB read, 141.66 MB/s read, 4.0 seconds Interval compaction: 1.22 GB write, 442.57 MB/s write, 0.42 GB read, 151.43 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 99632 Average: 1.7969 StdDev: 17.88 Min: 1 Median: 1.1105 Max: 3098 Percentiles: P50: 1.11 P75: 1.59 P99: 3.58 P99.9: 9.37 P99.99: 302.96 ------------------------------------------------------ [ 0, 1 ] 44097 44.260% 44.260% ######### ( 1, 2 ] 51760 51.951% 96.211% ########## ( 2, 3 ] 2210 2.218% 98.429% ( 3, 4 ] 988 0.992% 99.421% ( 4, 6 ] 324 0.325% 99.746% ( 6, 10 ] 182 0.183% 99.929% ( 10, 15 ] 37 0.037% 99.966% ( 15, 22 ] 8 0.008% 99.974% ( 22, 34 ] 2 0.002% 99.976% ( 110, 170 ] 9 0.009% 99.985% ( 170, 250 ] 3 0.003% 99.988% ( 250, 380 ] 5 0.005% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 1 read latency histogram (micros): Count: 28009 Average: 2.3421 StdDev: 26.60 Min: 0 Median: 1.1416 Max: 2893 Percentiles: P50: 1.14 P75: 1.62 P99: 6.87 P99.9: 139.73 P99.99: 1419.46 ------------------------------------------------------ [ 0, 1 ] 11947 42.654% 42.654% ######### ( 1, 2 ] 14530 51.876% 94.530% ########## ( 2, 3 ] 882 3.149% 97.679% # ( 3, 4 ] 202 0.721% 98.401% ( 4, 6 ] 128 0.457% 98.858% ( 6, 10 ] 183 0.653% 99.511% ( 10, 15 ] 47 0.168% 99.679% ( 15, 22 ] 6 0.021% 99.700% ( 22, 34 ] 1 0.004% 99.704% ( 34, 51 ] 37 0.132% 99.836% ( 51, 76 ] 13 0.046% 99.882% ( 76, 110 ] 4 0.014% 99.896% ( 110, 170 ] 2 0.007% 99.904% ( 170, 250 ] 14 0.050% 99.954% ( 250, 380 ] 4 0.014% 99.968% ( 380, 580 ] 2 0.007% 99.975% ( 580, 870 ] 2 0.007% 99.982% ( 870, 1300 ] 2 0.007% 99.989% ( 1300, 1900 ] 1 0.004% 99.993% ( 1900, 2900 ] 2 0.007% 100.000% ** Level 2 read latency histogram (micros): Count: 15889 Average: 1.6442 StdDev: 3.60 Min: 1 Median: 1.0770 Max: 308 Percentiles: P50: 1.08 P75: 1.57 P99: 2.99 P99.9: 8.53 P99.99: 226.44 ------------------------------------------------------ [ 0, 1 ] 7324 46.095% 46.095% ######### ( 1, 2 ] 8056 50.702% 96.797% ########## ( 2, 3 ] 352 2.215% 99.012% ( 3, 4 ] 101 0.636% 99.648% ( 4, 6 ] 30 0.189% 99.836% ( 6, 10 ] 16 0.101% 99.937% ( 10, 15 ] 4 0.025% 99.962% ( 15, 22 ] 2 0.013% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 728.5250 StdDev: 924.31 Min: 0 Median: 190.0000 Max: 3039 Percentiles: P50: 190.00 P75: 1450.00 P99: 3039.00 P99.9: 3039.00 P99.99: 3039.00 ------------------------------------------------------ [ 0, 1 ] 29 36.250% 36.250% ####### ( 1, 2 ] 6 7.500% 43.750% ## ( 2, 3 ] 2 2.500% 46.250% # ( 3, 4 ] 1 1.250% 47.500% ( 76, 110 ] 1 1.250% 48.750% ( 170, 250 ] 4 5.000% 53.750% # ( 250, 380 ] 4 5.000% 58.750% # ( 580, 870 ] 7 8.750% 67.500% ## ( 870, 1300 ] 3 3.750% 71.250% # ( 1300, 1900 ] 12 15.000% 86.250% ### ( 1900, 2900 ] 9 11.250% 97.500% ## ( 2900, 4400 ] 2 2.500% 100.000% # ** Level 4 read latency histogram (micros): Count: 35 Average: 1610.8286 StdDev: 1187.18 Min: 447 Median: 1381.8182 Max: 5253 Percentiles: P50: 1381.82 P75: 1859.09 P99: 5253.00 P99.9: 5253.00 P99.99: 5253.00 ------------------------------------------------------ ( 380, 580 ] 6 17.143% 17.143% ### ( 580, 870 ] 6 17.143% 34.286% ### ( 870, 1300 ] 4 11.429% 45.714% ## ( 1300, 1900 ] 11 31.429% 77.143% ###### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 327.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.176 H:M:S, 5.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.176 H:M:S, 6.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-10:34:34 ... thread 0: (1000000,2000000) ops and (319726.4,336785.0) ops/second in (3.127674,5.938506) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 1.17 GB 6.3 0.7 0.0 0.7 2.5 1.8 0.0 1.4 94.1 321.5 8.03 7.41 29 0.277 767K 724 0.0 0.0 L1 2/2 50.40 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 248.2 247.8 3.30 3.21 2 1.649 831K 1414 0.0 0.0 L2 5/4 563.82 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 16/9 692.48 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.1 210.1 0.30 0.25 1 0.298 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1191/22 97.92 GB 0.0 1.7 0.6 1.1 3.5 2.4 0.7 2.0 144.9 296.1 12.07 11.29 33 0.366 1775K 2172 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.6 1.1 3.5 2.4 0.7 2.0 144.9 296.1 12.07 11.29 33 0.366 1775K 2172 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.6 1.1 1.7 0.6 0.0 0.0 254.9 254.5 6.86 6.65 7 0.980 1775K 2172 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.8 5.21 4.64 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.49 GB write, 582.54 MB/s write, 1.71 GB read, 285.08 MB/s read, 12.1 seconds Interval compaction: 3.49 GB write, 601.56 MB/s write, 1.71 GB read, 294.39 MB/s read, 12.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 360084 Average: 2.0451 StdDev: 13.99 Min: 0 Median: 1.3612 Max: 3173 Percentiles: P50: 1.36 P75: 1.78 P99: 5.39 P99.9: 9.78 P99.99: 28.84 ------------------------------------------------------ [ 0, 1 ] 101460 28.177% 28.177% ###### ( 1, 2 ] 217544 60.415% 88.592% ############ ( 2, 3 ] 22318 6.198% 94.790% # ( 3, 4 ] 10772 2.992% 97.781% # ( 4, 6 ] 6324 1.756% 99.537% ( 6, 10 ] 1383 0.384% 99.921% ( 10, 15 ] 215 0.060% 99.981% ( 15, 22 ] 28 0.008% 99.989% ( 22, 34 ] 7 0.002% 99.991% ( 34, 51 ] 3 0.001% 99.992% ( 51, 76 ] 2 0.001% 99.992% ( 110, 170 ] 13 0.004% 99.996% ( 170, 250 ] 11 0.003% 99.999% ( 250, 380 ] 10 0.003% 100.002% ( 380, 580 ] 2 0.001% 100.002% ( 580, 870 ] 7 0.002% 100.004% ( 870, 1300 ] 3 0.001% 100.005% ( 1300, 1900 ] 5 0.001% 100.006% ( 1900, 2900 ] 4 0.001% 100.007% ( 2900, 4400 ] 3 0.001% 100.008% ** Level 1 read latency histogram (micros): Count: 134716 Average: 2.2631 StdDev: 13.88 Min: 0 Median: 1.4576 Max: 2893 Percentiles: P50: 1.46 P75: 1.86 P99: 5.78 P99.9: 14.46 P99.99: 415.23 ------------------------------------------------------ [ 0, 1 ] 29139 21.630% 21.630% #### ( 1, 2 ] 83528 62.003% 83.633% ############ ( 2, 3 ] 12548 9.314% 92.947% ## ( 3, 4 ] 4979 3.696% 96.643% # ( 4, 6 ] 3559 2.642% 99.285% # ( 6, 10 ] 698 0.518% 99.803% ( 10, 15 ] 146 0.108% 99.912% ( 15, 22 ] 22 0.016% 99.928% ( 22, 34 ] 3 0.002% 99.930% ( 34, 51 ] 37 0.027% 99.958% ( 51, 76 ] 14 0.010% 99.968% ( 76, 110 ] 4 0.003% 99.971% ( 110, 170 ] 3 0.002% 99.973% ( 170, 250 ] 14 0.010% 99.984% ( 250, 380 ] 8 0.006% 99.990% ( 380, 580 ] 3 0.002% 99.992% ( 580, 870 ] 2 0.001% 99.993% ( 870, 1300 ] 6 0.004% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15942 Average: 1.6492 StdDev: 3.60 Min: 1 Median: 1.0801 Max: 308 Percentiles: P50: 1.08 P75: 1.57 P99: 3.08 P99.9: 8.76 P99.99: 226.23 ------------------------------------------------------ [ 0, 1 ] 7324 45.942% 45.942% ######### ( 1, 2 ] 8078 50.671% 96.613% ########## ( 2, 3 ] 372 2.333% 98.946% ( 3, 4 ] 105 0.659% 99.605% ( 4, 6 ] 36 0.226% 99.831% ( 6, 10 ] 16 0.100% 99.931% ( 10, 15 ] 5 0.031% 99.962% ( 15, 22 ] 2 0.013% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 86483 Average: 4.0149 StdDev: 43.52 Min: 0 Median: 1.5862 Max: 4057 Percentiles: P50: 1.59 P75: 2.07 P99: 9.85 P99.9: 365.79 P99.99: 1639.31 ------------------------------------------------------ [ 0, 1 ] 13664 15.800% 15.800% ### ( 1, 2 ] 50459 58.346% 74.145% ############ ( 2, 3 ] 11076 12.807% 86.952% ### ( 3, 4 ] 5075 5.868% 92.821% # ( 4, 6 ] 3731 4.314% 97.135% # ( 6, 10 ] 1678 1.940% 99.075% ( 10, 15 ] 339 0.392% 99.467% ( 15, 22 ] 66 0.076% 99.543% ( 22, 34 ] 16 0.019% 99.562% ( 34, 51 ] 7 0.008% 99.570% ( 51, 76 ] 7 0.008% 99.578% ( 76, 110 ] 104 0.120% 99.698% ( 110, 170 ] 86 0.099% 99.798% ( 170, 250 ] 52 0.060% 99.858% ( 250, 380 ] 41 0.047% 99.905% ( 380, 580 ] 37 0.043% 99.948% ( 580, 870 ] 23 0.027% 99.975% ( 870, 1300 ] 6 0.007% 99.981% ( 1300, 1900 ] 13 0.015% 99.997% ( 1900, 2900 ] 9 0.010% 100.007% ( 2900, 4400 ] 4 0.005% 100.012% ** Level 4 read latency histogram (micros): Count: 35 Average: 1610.8286 StdDev: 1187.18 Min: 447 Median: 1381.8182 Max: 5253 Percentiles: P50: 1381.82 P75: 1859.09 P99: 5253.00 P99.9: 5253.00 P99.99: 5253.00 ------------------------------------------------------ ( 380, 580 ] 6 17.143% 17.143% ### ( 580, 870 ] 6 17.143% 34.286% ### ( 870, 1300 ] 4 11.429% 45.714% ## ( 1300, 1900 ] 11 31.429% 77.143% ###### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.573 H:M:S, 9.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.397 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/27-10:34:37 ... thread 0: (1000000,3000000) ops and (320282.7,331098.5) ops/second in (3.122242,9.060748) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.15 GB 75.5 1.2 0.0 1.2 4.0 2.8 0.0 1.4 98.6 320.4 12.78 11.81 45 0.284 1279K 1193 0.0 0.0 L1 2/2 50.40 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 248.2 247.8 3.30 3.21 2 1.649 831K 1414 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 34/0 980.19 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 214.5 214.4 6.22 5.46 4 1.555 1335K 685 0.0 0.0 L4 140/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1240/13 98.90 GB 0.0 3.4 1.2 2.3 6.2 3.9 1.2 2.2 155.0 279.5 22.74 20.90 52 0.437 3559K 3326 0.0 0.0 Int 0/0 0.00 KB 0.0 3.4 1.2 2.3 6.2 3.9 1.2 2.2 155.0 279.5 22.74 20.90 52 0.437 3559K 3326 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.4 1.2 2.3 3.4 1.2 0.0 0.0 240.5 240.3 14.66 13.69 12 1.221 3559K 3326 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 350.7 8.08 7.20 40 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.21 GB write, 686.69 MB/s write, 3.44 GB read, 380.80 MB/s read, 22.7 seconds Interval compaction: 6.21 GB write, 701.38 MB/s write, 3.44 GB read, 388.95 MB/s read, 22.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 706477 Average: 2.1851 StdDev: 12.80 Min: 0 Median: 1.4435 Max: 3173 Percentiles: P50: 1.44 P75: 1.84 P99: 5.67 P99.9: 10.11 P99.99: 96.64 ------------------------------------------------------ [ 0, 1 ] 156763 22.189% 22.189% #### ( 1, 2 ] 442981 62.703% 84.892% ############# ( 2, 3 ] 57039 8.074% 92.966% ## ( 3, 4 ] 27499 3.892% 96.858% # ( 4, 6 ] 18163 2.571% 99.429% # ( 6, 10 ] 3314 0.469% 99.898% ( 10, 15 ] 547 0.077% 99.976% ( 15, 22 ] 68 0.010% 99.985% ( 22, 34 ] 9 0.001% 99.987% ( 34, 51 ] 5 0.001% 99.987% ( 51, 76 ] 5 0.001% 99.988% ( 76, 110 ] 22 0.003% 99.991% ( 110, 170 ] 63 0.009% 100.000% ( 170, 250 ] 47 0.007% 100.007% ( 250, 380 ] 21 0.003% 100.010% ( 380, 580 ] 12 0.002% 100.011% ( 580, 870 ] 21 0.003% 100.014% ( 870, 1300 ] 3 0.000% 100.015% ( 1300, 1900 ] 9 0.001% 100.016% ( 1900, 2900 ] 7 0.001% 100.017% ( 2900, 4400 ] 3 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 207010 Average: 2.3040 StdDev: 11.22 Min: 0 Median: 1.5144 Max: 2893 Percentiles: P50: 1.51 P75: 1.91 P99: 5.87 P99.9: 13.65 P99.99: 271.11 ------------------------------------------------------ [ 0, 1 ] 36668 17.713% 17.713% #### ( 1, 2 ] 129931 62.766% 80.479% ############# ( 2, 3 ] 21997 10.626% 91.105% ## ( 3, 4 ] 9424 4.552% 95.657% # ( 4, 6 ] 7395 3.572% 99.230% # ( 6, 10 ] 1187 0.573% 99.803% ( 10, 15 ] 275 0.133% 99.936% ( 15, 22 ] 35 0.017% 99.953% ( 22, 34 ] 3 0.001% 99.954% ( 34, 51 ] 38 0.018% 99.972% ( 51, 76 ] 14 0.007% 99.979% ( 76, 110 ] 4 0.002% 99.981% ( 110, 170 ] 3 0.001% 99.983% ( 170, 250 ] 14 0.007% 99.989% ( 250, 380 ] 8 0.004% 99.993% ( 380, 580 ] 3 0.001% 99.995% ( 580, 870 ] 2 0.001% 99.996% ( 870, 1300 ] 6 0.003% 99.999% ( 1300, 1900 ] 1 0.000% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28271 Average: 1.9424 StdDev: 2.83 Min: 1 Median: 1.3198 Max: 308 Percentiles: P50: 1.32 P75: 1.77 P99: 5.50 P99.9: 10.39 P99.99: 176.92 ------------------------------------------------------ [ 0, 1 ] 9136 32.316% 32.316% ###### ( 1, 2 ] 15631 55.290% 87.606% ########### ( 2, 3 ] 1707 6.038% 93.644% # ( 3, 4 ] 1010 3.573% 97.216% # ( 4, 6 ] 674 2.384% 99.600% ( 6, 10 ] 83 0.294% 99.894% ( 10, 15 ] 22 0.078% 99.972% ( 15, 22 ] 4 0.014% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180259 Average: 3.5980 StdDev: 32.82 Min: 0 Median: 1.5931 Max: 4057 Percentiles: P50: 1.59 P75: 2.08 P99: 9.56 P99.9: 277.20 P99.99: 853.68 ------------------------------------------------------ [ 0, 1 ] 27118 15.044% 15.044% ### ( 1, 2 ] 106242 58.939% 73.982% ############ ( 2, 3 ] 22484 12.473% 86.456% ## ( 3, 4 ] 11274 6.254% 92.710% # ( 4, 6 ] 8295 4.602% 97.312% # ( 6, 10 ] 3424 1.899% 99.211% ( 10, 15 ] 599 0.332% 99.543% ( 15, 22 ] 105 0.058% 99.602% ( 22, 34 ] 24 0.013% 99.615% ( 34, 51 ] 23 0.013% 99.628% ( 51, 76 ] 9 0.005% 99.633% ( 76, 110 ] 160 0.089% 99.722% ( 110, 170 ] 192 0.107% 99.828% ( 170, 250 ] 113 0.063% 99.891% ( 250, 380 ] 80 0.044% 99.935% ( 380, 580 ] 65 0.036% 99.971% ( 580, 870 ] 36 0.020% 99.991% ( 870, 1300 ] 10 0.006% 99.997% ( 1300, 1900 ] 15 0.008% 100.005% ( 1900, 2900 ] 9 0.005% 100.010% ( 2900, 4400 ] 4 0.002% 100.012% ** Level 4 read latency histogram (micros): Count: 35 Average: 1610.8286 StdDev: 1187.18 Min: 447 Median: 1381.8182 Max: 5253 Percentiles: P50: 1381.82 P75: 1859.09 P99: 5253.00 P99.9: 5253.00 P99.99: 5253.00 ------------------------------------------------------ ( 380, 580 ] 6 17.143% 17.143% ### ( 580, 870 ] 6 17.143% 34.286% ### ( 870, 1300 ] 4 11.429% 45.714% ## ( 1300, 1900 ] 11 31.429% 77.143% ###### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 744.1500 StdDev: 792.33 Min: 80 Median: 223.3333 Max: 2515 Percentiles: P50: 223.33 P75: 1300.00 P99: 2515.00 P99.9: 2515.00 P99.99: 2515.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 3 15.000% 55.000% ### ( 380, 580 ] 1 5.000% 60.000% # ( 870, 1300 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.3 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 318.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.944 H:M:S, 10.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.371 H:M:S, 11.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-10:34:40 ... thread 0: (1000000,4000000) ops and (349272.9,335462.4) ops/second in (2.863091,11.923839) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 1.97 GB 176.2 2.3 0.0 2.3 6.0 3.7 0.0 1.6 120.2 314.9 19.40 18.05 64 0.303 2366K 2281 0.0 0.0 L1 10/0 1.15 GB 117.7 2.0 1.6 0.4 1.9 1.6 0.1 1.2 237.0 236.1 8.45 8.17 3 2.816 2033K 7328 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 34/0 980.19 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 214.5 214.4 6.22 5.46 4 1.555 1335K 685 0.0 0.0 L4 140/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/4 99.82 GB 0.0 5.6 2.3 3.4 9.3 6.0 1.2 2.5 167.5 276.7 34.51 32.10 72 0.479 5848K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 2.3 3.4 9.3 6.0 1.2 2.5 167.5 276.7 34.51 32.10 72 0.479 5848K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 2.3 3.4 5.6 2.3 0.0 0.0 242.4 241.9 23.84 22.61 17 1.403 5848K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 354.4 10.66 9.49 55 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.32 GB write, 787.87 MB/s write, 5.64 GB read, 476.87 MB/s read, 34.5 seconds Interval compaction: 9.32 GB write, 800.69 MB/s write, 5.64 GB read, 484.63 MB/s read, 34.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 10, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1061077 Average: 2.1912 StdDev: 11.99 Min: 0 Median: 1.4434 Max: 3173 Percentiles: P50: 1.44 P75: 1.84 P99: 5.69 P99.9: 9.99 P99.99: 84.05 ------------------------------------------------------ [ 0, 1 ] 233027 21.961% 21.961% #### ( 1, 2 ] 671051 63.242% 85.204% ############# ( 2, 3 ] 84388 7.953% 93.157% ## ( 3, 4 ] 40131 3.782% 96.939% # ( 4, 6 ] 25931 2.444% 99.383% ( 6, 10 ] 5498 0.518% 99.901% ( 10, 15 ] 811 0.076% 99.977% ( 15, 22 ] 97 0.009% 99.987% ( 22, 34 ] 12 0.001% 99.988% ( 34, 51 ] 8 0.001% 99.988% ( 51, 76 ] 7 0.001% 99.989% ( 76, 110 ] 46 0.004% 99.993% ( 110, 170 ] 114 0.011% 100.004% ( 170, 250 ] 80 0.008% 100.012% ( 250, 380 ] 52 0.005% 100.017% ( 380, 580 ] 30 0.003% 100.019% ( 580, 870 ] 34 0.003% 100.023% ( 870, 1300 ] 11 0.001% 100.024% ( 1300, 1900 ] 10 0.001% 100.025% ( 1900, 2900 ] 7 0.001% 100.025% ( 2900, 4400 ] 4 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 219857 Average: 2.4733 StdDev: 15.45 Min: 0 Median: 1.5138 Max: 2893 Percentiles: P50: 1.51 P75: 1.91 P99: 5.93 P99.9: 43.46 P99.99: 677.36 ------------------------------------------------------ [ 0, 1 ] 38749 17.625% 17.625% #### ( 1, 2 ] 138534 63.011% 80.636% ############# ( 2, 3 ] 23092 10.503% 91.139% ## ( 3, 4 ] 9867 4.488% 95.627% # ( 4, 6 ] 7674 3.490% 99.117% # ( 6, 10 ] 1371 0.624% 99.741% ( 10, 15 ] 288 0.131% 99.872% ( 15, 22 ] 37 0.017% 99.889% ( 22, 34 ] 4 0.002% 99.890% ( 34, 51 ] 38 0.017% 99.908% ( 51, 76 ] 15 0.007% 99.914% ( 76, 110 ] 44 0.020% 99.935% ( 110, 170 ] 50 0.023% 99.957% ( 170, 250 ] 34 0.015% 99.973% ( 250, 380 ] 23 0.010% 99.983% ( 380, 580 ] 13 0.006% 99.989% ( 580, 870 ] 6 0.003% 99.992% ( 870, 1300 ] 10 0.005% 99.996% ( 1300, 1900 ] 5 0.002% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28271 Average: 1.9424 StdDev: 2.83 Min: 1 Median: 1.3198 Max: 308 Percentiles: P50: 1.32 P75: 1.77 P99: 5.50 P99.9: 10.39 P99.99: 176.92 ------------------------------------------------------ [ 0, 1 ] 9136 32.316% 32.316% ###### ( 1, 2 ] 15631 55.290% 87.606% ########### ( 2, 3 ] 1707 6.038% 93.644% # ( 3, 4 ] 1010 3.573% 97.216% # ( 4, 6 ] 674 2.384% 99.600% ( 6, 10 ] 83 0.294% 99.894% ( 10, 15 ] 22 0.078% 99.972% ( 15, 22 ] 4 0.014% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180259 Average: 3.5980 StdDev: 32.82 Min: 0 Median: 1.5931 Max: 4057 Percentiles: P50: 1.59 P75: 2.08 P99: 9.56 P99.9: 277.20 P99.99: 853.68 ------------------------------------------------------ [ 0, 1 ] 27118 15.044% 15.044% ### ( 1, 2 ] 106242 58.939% 73.982% ############ ( 2, 3 ] 22484 12.473% 86.456% ## ( 3, 4 ] 11274 6.254% 92.710% # ( 4, 6 ] 8295 4.602% 97.312% # ( 6, 10 ] 3424 1.899% 99.211% ( 10, 15 ] 599 0.332% 99.543% ( 15, 22 ] 105 0.058% 99.602% ( 22, 34 ] 24 0.013% 99.615% ( 34, 51 ] 23 0.013% 99.628% ( 51, 76 ] 9 0.005% 99.633% ( 76, 110 ] 160 0.089% 99.722% ( 110, 170 ] 192 0.107% 99.828% ( 170, 250 ] 113 0.063% 99.891% ( 250, 380 ] 80 0.044% 99.935% ( 380, 580 ] 65 0.036% 99.971% ( 580, 870 ] 36 0.020% 99.991% ( 870, 1300 ] 10 0.006% 99.997% ( 1300, 1900 ] 15 0.008% 100.005% ( 1900, 2900 ] 9 0.005% 100.010% ( 2900, 4400 ] 4 0.002% 100.012% ** Level 4 read latency histogram (micros): Count: 35 Average: 1610.8286 StdDev: 1187.18 Min: 447 Median: 1381.8182 Max: 5253 Percentiles: P50: 1381.82 P75: 1859.09 P99: 5253.00 P99.9: 5253.00 P99.99: 5253.00 ------------------------------------------------------ ( 380, 580 ] 6 17.143% 17.143% ### ( 580, 870 ] 6 17.143% 34.286% ### ( 870, 1300 ] 4 11.429% 45.714% ## ( 1300, 1900 ] 11 31.429% 77.143% ###### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 744.1500 StdDev: 792.33 Min: 80 Median: 223.3333 Max: 2515 Percentiles: P50: 223.33 P75: 1300.00 P99: 2515.00 P99.9: 2515.00 P99.99: 2515.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 3 15.000% 55.000% ### ( 380, 580 ] 1 5.000% 60.000% # ( 870, 1300 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.1 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.106 H:M:S, 9.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.162 H:M:S, 5.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-10:34:43 ... thread 0: (1000000,5000000) ops and (314086.5,330957.6) ops/second in (3.183836,15.107675) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.01 GB 31.5 3.0 0.0 3.0 7.7 4.7 0.0 1.6 123.1 316.4 25.08 23.37 83 0.302 3134K 3060 0.0 0.0 L1 10/10 1.15 GB 0.0 2.0 1.6 0.4 1.9 1.6 0.1 1.2 237.0 236.1 8.45 8.17 3 2.816 2033K 7328 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 34/0 980.19 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 214.5 214.4 6.22 5.46 4 1.555 1335K 685 0.0 0.0 L4 140/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/27 100.86 GB 0.0 6.4 2.3 4.1 11.1 7.0 1.2 2.3 162.6 283.0 40.19 37.42 91 0.442 6615K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 2.3 4.1 11.1 7.0 1.2 2.3 162.6 283.0 40.19 37.42 91 0.442 6615K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 2.3 4.1 6.4 2.3 0.0 0.0 245.7 245.2 26.60 25.32 20 1.330 6615K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.9 13.59 12.10 71 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.1 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.11 GB write, 743.29 MB/s write, 6.38 GB read, 427.06 MB/s read, 40.2 seconds Interval compaction: 11.11 GB write, 752.83 MB/s write, 6.38 GB read, 432.54 MB/s read, 40.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 12, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1326285 Average: 2.1784 StdDev: 12.77 Min: 0 Median: 1.4249 Max: 3179 Percentiles: P50: 1.42 P75: 1.82 P99: 5.63 P99.9: 10.47 P99.99: 125.89 ------------------------------------------------------ [ 0, 1 ] 308511 23.261% 23.261% ##### ( 1, 2 ] 834676 62.933% 86.195% ############# ( 2, 3 ] 99437 7.497% 93.692% # ( 3, 4 ] 46602 3.514% 97.206% # ( 4, 6 ] 29272 2.207% 99.413% ( 6, 10 ] 6370 0.480% 99.893% ( 10, 15 ] 980 0.074% 99.967% ( 15, 22 ] 116 0.009% 99.976% ( 22, 34 ] 15 0.001% 99.977% ( 34, 51 ] 9 0.001% 99.978% ( 51, 76 ] 7 0.001% 99.978% ( 76, 110 ] 107 0.008% 99.986% ( 110, 170 ] 194 0.015% 100.001% ( 170, 250 ] 110 0.008% 100.009% ( 250, 380 ] 66 0.005% 100.014% ( 380, 580 ] 48 0.004% 100.018% ( 580, 870 ] 44 0.003% 100.021% ( 870, 1300 ] 15 0.001% 100.022% ( 1300, 1900 ] 13 0.001% 100.023% ( 1900, 2900 ] 9 0.001% 100.024% ( 2900, 4400 ] 7 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 252041 Average: 2.4686 StdDev: 14.84 Min: 0 Median: 1.5028 Max: 2893 Percentiles: P50: 1.50 P75: 1.90 P99: 6.12 P99.9: 75.93 P99.99: 577.96 ------------------------------------------------------ [ 0, 1 ] 46033 18.264% 18.264% #### ( 1, 2 ] 159071 63.113% 81.377% ############# ( 2, 3 ] 25351 10.058% 91.436% ## ( 3, 4 ] 10806 4.287% 95.723% # ( 4, 6 ] 8203 3.255% 98.978% # ( 6, 10 ] 1896 0.752% 99.730% ( 10, 15 ] 329 0.131% 99.860% ( 15, 22 ] 43 0.017% 99.877% ( 22, 34 ] 4 0.002% 99.879% ( 34, 51 ] 38 0.015% 99.894% ( 51, 76 ] 15 0.006% 99.900% ( 76, 110 ] 58 0.023% 99.923% ( 110, 170 ] 81 0.032% 99.955% ( 170, 250 ] 42 0.017% 99.972% ( 250, 380 ] 26 0.010% 99.982% ( 380, 580 ] 20 0.008% 99.990% ( 580, 870 ] 7 0.003% 99.993% ( 870, 1300 ] 10 0.004% 99.997% ( 1300, 1900 ] 5 0.002% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28271 Average: 1.9424 StdDev: 2.83 Min: 1 Median: 1.3198 Max: 308 Percentiles: P50: 1.32 P75: 1.77 P99: 5.50 P99.9: 10.39 P99.99: 176.92 ------------------------------------------------------ [ 0, 1 ] 9136 32.316% 32.316% ###### ( 1, 2 ] 15631 55.290% 87.606% ########### ( 2, 3 ] 1707 6.038% 93.644% # ( 3, 4 ] 1010 3.573% 97.216% # ( 4, 6 ] 674 2.384% 99.600% ( 6, 10 ] 83 0.294% 99.894% ( 10, 15 ] 22 0.078% 99.972% ( 15, 22 ] 4 0.014% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180259 Average: 3.5980 StdDev: 32.82 Min: 0 Median: 1.5931 Max: 4057 Percentiles: P50: 1.59 P75: 2.08 P99: 9.56 P99.9: 277.20 P99.99: 853.68 ------------------------------------------------------ [ 0, 1 ] 27118 15.044% 15.044% ### ( 1, 2 ] 106242 58.939% 73.982% ############ ( 2, 3 ] 22484 12.473% 86.456% ## ( 3, 4 ] 11274 6.254% 92.710% # ( 4, 6 ] 8295 4.602% 97.312% # ( 6, 10 ] 3424 1.899% 99.211% ( 10, 15 ] 599 0.332% 99.543% ( 15, 22 ] 105 0.058% 99.602% ( 22, 34 ] 24 0.013% 99.615% ( 34, 51 ] 23 0.013% 99.628% ( 51, 76 ] 9 0.005% 99.633% ( 76, 110 ] 160 0.089% 99.722% ( 110, 170 ] 192 0.107% 99.828% ( 170, 250 ] 113 0.063% 99.891% ( 250, 380 ] 80 0.044% 99.935% ( 380, 580 ] 65 0.036% 99.971% ( 580, 870 ] 36 0.020% 99.991% ( 870, 1300 ] 10 0.006% 99.997% ( 1300, 1900 ] 15 0.008% 100.005% ( 1900, 2900 ] 9 0.005% 100.010% ( 2900, 4400 ] 4 0.002% 100.012% ** Level 4 read latency histogram (micros): Count: 35 Average: 1610.8286 StdDev: 1187.18 Min: 447 Median: 1381.8182 Max: 5253 Percentiles: P50: 1381.82 P75: 1859.09 P99: 5253.00 P99.9: 5253.00 P99.99: 5253.00 ------------------------------------------------------ ( 380, 580 ] 6 17.143% 17.143% ### ( 580, 870 ] 6 17.143% 34.286% ### ( 870, 1300 ] 4 11.429% 45.714% ## ( 1300, 1900 ] 11 31.429% 77.143% ###### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 744.1500 StdDev: 792.33 Min: 80 Median: 223.3333 Max: 2515 Percentiles: P50: 223.33 P75: 1300.00 P99: 2515.00 P99.9: 2515.00 P99.99: 2515.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 3 15.000% 55.000% ### ( 380, 580 ] 1 5.000% 60.000% # ( 870, 1300 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 15.3 total, 3.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 321.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.604 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 309.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.498 H:M:S, 15.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-10:34:51 ... thread 0: (1000000,6000000) ops and (116085.0,252929.2) ops/second in (8.614380,23.722055) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.93 GB 150.6 5.0 0.0 5.0 10.7 5.7 0.0 1.9 146.1 309.7 35.36 33.24 103 0.343 5244K 8718 0.0 0.0 L1 10/10 1.15 GB 0.0 2.0 1.6 0.4 1.9 1.6 0.1 1.2 237.0 236.1 8.45 8.17 3 2.816 2033K 7328 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 34/0 980.19 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 214.5 214.4 6.22 5.46 4 1.555 1335K 685 0.0 0.0 L4 140/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/23 101.78 GB 0.0 8.4 2.3 6.1 14.1 7.9 1.2 2.5 170.6 285.1 50.48 47.29 111 0.455 8725K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.4 2.3 6.1 14.1 7.9 1.2 2.5 170.6 285.1 50.48 47.29 111 0.455 8725K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.4 2.3 6.1 8.4 2.3 0.0 0.0 251.7 251.2 34.22 32.80 25 1.369 8725K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 356.6 16.25 14.48 86 0.189 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.9 total, 23.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.05 GB write, 601.73 MB/s write, 8.41 GB read, 360.13 MB/s read, 50.5 seconds Interval compaction: 14.05 GB write, 606.65 MB/s write, 8.41 GB read, 363.07 MB/s read, 50.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 12, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2177034 Average: 2.1658 StdDev: 11.70 Min: 0 Median: 1.4189 Max: 3179 Percentiles: P50: 1.42 P75: 1.81 P99: 5.62 P99.9: 11.36 P99.99: 142.85 ------------------------------------------------------ [ 0, 1 ] 502967 23.103% 23.103% ##### ( 1, 2 ] 1397731 64.203% 87.307% ############# ( 2, 3 ] 151094 6.940% 94.247% # ( 3, 4 ] 70391 3.233% 97.480% # ( 4, 6 ] 40895 1.878% 99.359% ( 6, 10 ] 11382 0.523% 99.882% ( 10, 15 ] 1458 0.067% 99.949% ( 15, 22 ] 197 0.009% 99.958% ( 22, 34 ] 17 0.001% 99.959% ( 34, 51 ] 11 0.001% 99.959% ( 51, 76 ] 12 0.001% 99.960% ( 76, 110 ] 411 0.019% 99.979% ( 110, 170 ] 459 0.021% 100.000% ( 170, 250 ] 180 0.008% 100.008% ( 250, 380 ] 114 0.005% 100.013% ( 380, 580 ] 89 0.004% 100.017% ( 580, 870 ] 65 0.003% 100.020% ( 870, 1300 ] 19 0.001% 100.021% ( 1300, 1900 ] 19 0.001% 100.022% ( 1900, 2900 ] 12 0.001% 100.022% ( 2900, 4400 ] 8 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 407628 Average: 2.4465 StdDev: 14.02 Min: 0 Median: 1.4778 Max: 3309 Percentiles: P50: 1.48 P75: 1.87 P99: 7.22 P99.9: 106.32 P99.99: 540.22 ------------------------------------------------------ [ 0, 1 ] 78191 19.182% 19.182% #### ( 1, 2 ] 262903 64.496% 83.678% ############# ( 2, 3 ] 35413 8.688% 92.365% ## ( 3, 4 ] 15098 3.704% 96.069% # ( 4, 6 ] 10670 2.618% 98.687% # ( 6, 10 ] 4200 1.030% 99.717% ( 10, 15 ] 460 0.113% 99.830% ( 15, 22 ] 62 0.015% 99.845% ( 22, 34 ] 6 0.001% 99.847% ( 34, 51 ] 38 0.009% 99.856% ( 51, 76 ] 26 0.006% 99.862% ( 76, 110 ] 172 0.042% 99.905% ( 110, 170 ] 208 0.051% 99.956% ( 170, 250 ] 70 0.017% 99.973% ( 250, 380 ] 43 0.011% 99.983% ( 380, 580 ] 34 0.008% 99.992% ( 580, 870 ] 15 0.004% 99.995% ( 870, 1300 ] 10 0.002% 99.998% ( 1300, 1900 ] 5 0.001% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28271 Average: 1.9424 StdDev: 2.83 Min: 1 Median: 1.3198 Max: 308 Percentiles: P50: 1.32 P75: 1.77 P99: 5.50 P99.9: 10.39 P99.99: 176.92 ------------------------------------------------------ [ 0, 1 ] 9136 32.316% 32.316% ###### ( 1, 2 ] 15631 55.290% 87.606% ########### ( 2, 3 ] 1707 6.038% 93.644% # ( 3, 4 ] 1010 3.573% 97.216% # ( 4, 6 ] 674 2.384% 99.600% ( 6, 10 ] 83 0.294% 99.894% ( 10, 15 ] 22 0.078% 99.972% ( 15, 22 ] 4 0.014% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 180259 Average: 3.5980 StdDev: 32.82 Min: 0 Median: 1.5931 Max: 4057 Percentiles: P50: 1.59 P75: 2.08 P99: 9.56 P99.9: 277.20 P99.99: 853.68 ------------------------------------------------------ [ 0, 1 ] 27118 15.044% 15.044% ### ( 1, 2 ] 106242 58.939% 73.982% ############ ( 2, 3 ] 22484 12.473% 86.456% ## ( 3, 4 ] 11274 6.254% 92.710% # ( 4, 6 ] 8295 4.602% 97.312% # ( 6, 10 ] 3424 1.899% 99.211% ( 10, 15 ] 599 0.332% 99.543% ( 15, 22 ] 105 0.058% 99.602% ( 22, 34 ] 24 0.013% 99.615% ( 34, 51 ] 23 0.013% 99.628% ( 51, 76 ] 9 0.005% 99.633% ( 76, 110 ] 160 0.089% 99.722% ( 110, 170 ] 192 0.107% 99.828% ( 170, 250 ] 113 0.063% 99.891% ( 250, 380 ] 80 0.044% 99.935% ( 380, 580 ] 65 0.036% 99.971% ( 580, 870 ] 36 0.020% 99.991% ( 870, 1300 ] 10 0.006% 99.997% ( 1300, 1900 ] 15 0.008% 100.005% ( 1900, 2900 ] 9 0.005% 100.010% ( 2900, 4400 ] 4 0.002% 100.012% ** Level 4 read latency histogram (micros): Count: 35 Average: 1610.8286 StdDev: 1187.18 Min: 447 Median: 1381.8182 Max: 5253 Percentiles: P50: 1381.82 P75: 1859.09 P99: 5253.00 P99.9: 5253.00 P99.99: 5253.00 ------------------------------------------------------ ( 380, 580 ] 6 17.143% 17.143% ### ( 580, 870 ] 6 17.143% 34.286% ### ( 870, 1300 ] 4 11.429% 45.714% ## ( 1300, 1900 ] 11 31.429% 77.143% ###### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 744.1500 StdDev: 792.33 Min: 80 Median: 223.3333 Max: 2515 Percentiles: P50: 223.33 P75: 1300.00 P99: 2515.00 P99.9: 2515.00 P99.99: 2515.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 3 15.000% 40.000% ### ( 170, 250 ] 3 15.000% 55.000% ### ( 380, 580 ] 1 5.000% 60.000% # ( 870, 1300 ] 3 15.000% 75.000% ### ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 23.9 total, 8.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 246.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.297 H:M:S, 30.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 114.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.693 H:M:S, 66.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-10:35:00 ... thread 0: (1000000,7000000) ops and (118878.3,217837.7) ops/second in (8.411967,32.134022) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 2.45 GB 25.2 6.6 0.0 6.6 13.2 6.6 0.0 2.0 150.5 302.2 44.78 41.50 122 0.367 6842K 11K 0.0 0.0 L1 28/28 2.04 GB 0.0 5.6 4.1 1.5 5.5 4.0 0.1 1.4 221.1 218.5 25.77 24.11 4 6.442 5785K 67K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.1 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 14/0 927.52 MB 0.9 1.3 0.6 0.7 1.3 0.6 1.5 2.1 214.5 214.4 6.22 5.46 4 1.555 1335K 685 0.0 0.0 L4 168/0 9.76 GB 1.0 0.9 0.8 0.1 0.9 0.8 1.0 1.2 139.4 138.8 6.80 4.39 6 1.134 934K 4175 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/33 102.70 GB 0.0 14.5 5.5 9.0 21.0 12.1 6.3 3.2 176.5 256.5 84.01 75.88 137 0.613 15M 83K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.5 5.5 9.0 21.0 12.1 6.3 3.2 176.5 256.5 84.01 75.88 137 0.613 15M 83K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.5 5.5 9.0 14.4 5.4 0.0 0.0 230.2 228.9 64.42 58.82 36 1.790 15M 83K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 347.3 19.59 17.05 101 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.3 total, 32.1 interval Flush(GB): cumulative 6.645, interval 6.645 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.05 GB write, 666.60 MB/s write, 14.48 GB read, 458.75 MB/s read, 84.0 seconds Interval compaction: 21.05 GB write, 670.62 MB/s write, 14.48 GB read, 461.52 MB/s read, 84.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 19, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2870083 Average: 2.5756 StdDev: 16.74 Min: 0 Median: 1.4263 Max: 4420 Percentiles: P50: 1.43 P75: 1.82 P99: 6.34 P99.9: 146.40 P99.99: 336.45 ------------------------------------------------------ [ 0, 1 ] 654557 22.806% 22.806% ##### ( 1, 2 ] 1830790 63.789% 86.595% ############# ( 2, 3 ] 202838 7.067% 93.662% # ( 3, 4 ] 94247 3.284% 96.946% # ( 4, 6 ] 57234 1.994% 98.940% ( 6, 10 ] 20195 0.704% 99.644% ( 10, 15 ] 2358 0.082% 99.726% ( 15, 22 ] 375 0.013% 99.739% ( 22, 34 ] 31 0.001% 99.740% ( 34, 51 ] 11 0.000% 99.741% ( 51, 76 ] 36 0.001% 99.742% ( 76, 110 ] 2614 0.091% 99.833% ( 110, 170 ] 3176 0.111% 99.944% ( 170, 250 ] 931 0.032% 99.976% ( 250, 380 ] 606 0.021% 99.997% ( 380, 580 ] 423 0.015% 100.012% ( 580, 870 ] 204 0.007% 100.019% ( 870, 1300 ] 48 0.002% 100.021% ( 1300, 1900 ] 29 0.001% 100.022% ( 1900, 2900 ] 22 0.001% 100.022% ( 2900, 4400 ] 16 0.001% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 681693 Average: 3.3571 StdDev: 36.70 Min: 0 Median: 1.5595 Max: 4713 Percentiles: P50: 1.56 P75: 1.97 P99: 8.79 P99.9: 207.85 P99.99: 1239.21 ------------------------------------------------------ [ 0, 1 ] 106022 15.553% 15.553% ### ( 1, 2 ] 419697 61.567% 77.120% ############ ( 2, 3 ] 74827 10.977% 88.096% ## ( 3, 4 ] 36506 5.355% 93.451% # ( 4, 6 ] 30518 4.477% 97.928% # ( 6, 10 ] 10482 1.538% 99.466% ( 10, 15 ] 1532 0.225% 99.691% ( 15, 22 ] 232 0.034% 99.725% ( 22, 34 ] 18 0.003% 99.727% ( 34, 51 ] 42 0.006% 99.733% ( 51, 76 ] 34 0.005% 99.738% ( 76, 110 ] 479 0.070% 99.809% ( 110, 170 ] 531 0.078% 99.887% ( 170, 250 ] 193 0.028% 99.915% ( 250, 380 ] 170 0.025% 99.940% ( 380, 580 ] 167 0.024% 99.964% ( 580, 870 ] 107 0.016% 99.980% ( 870, 1300 ] 79 0.012% 99.992% ( 1300, 1900 ] 49 0.007% 99.999% ( 1900, 2900 ] 34 0.005% 100.004% ( 2900, 4400 ] 22 0.003% 100.007% ( 4400, 6600 ] 5 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 28271 Average: 1.9424 StdDev: 2.83 Min: 1 Median: 1.3198 Max: 308 Percentiles: P50: 1.32 P75: 1.77 P99: 5.50 P99.9: 10.39 P99.99: 176.92 ------------------------------------------------------ [ 0, 1 ] 9136 32.316% 32.316% ###### ( 1, 2 ] 15631 55.290% 87.606% ########### ( 2, 3 ] 1707 6.038% 93.644% # ( 3, 4 ] 1010 3.573% 97.216% # ( 4, 6 ] 674 2.384% 99.600% ( 6, 10 ] 83 0.294% 99.894% ( 10, 15 ] 22 0.078% 99.972% ( 15, 22 ] 4 0.014% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 257429 Average: 6.8186 StdDev: 75.70 Min: 0 Median: 1.6448 Max: 5542 Percentiles: P50: 1.64 P75: 2.33 P99: 12.68 P99.9: 854.62 P99.99: 1718.81 ------------------------------------------------------ [ 0, 1 ] 33450 12.994% 12.994% ### ( 1, 2 ] 147732 57.387% 70.381% ########### ( 2, 3 ] 35892 13.942% 84.324% ### ( 3, 4 ] 18192 7.067% 91.391% # ( 4, 6 ] 13754 5.343% 96.733% # ( 6, 10 ] 5304 2.060% 98.794% ( 10, 15 ] 990 0.385% 99.178% ( 15, 22 ] 166 0.064% 99.243% ( 22, 34 ] 29 0.011% 99.254% ( 34, 51 ] 23 0.009% 99.263% ( 51, 76 ] 10 0.004% 99.267% ( 76, 110 ] 181 0.070% 99.337% ( 110, 170 ] 283 0.110% 99.447% ( 170, 250 ] 253 0.098% 99.546% ( 250, 380 ] 311 0.121% 99.666% ( 380, 580 ] 344 0.134% 99.800% ( 580, 870 ] 272 0.106% 99.906% ( 870, 1300 ] 167 0.065% 99.970% ( 1300, 1900 ] 72 0.028% 99.998% ( 1900, 2900 ] 42 0.016% 100.015% ( 2900, 4400 ] 41 0.016% 100.031% ( 4400, 6600 ] 4 0.002% 100.032% ** Level 4 read latency histogram (micros): Count: 215 Average: 334.4465 StdDev: 771.19 Min: 0 Median: 2.7955 Max: 5253 Percentiles: P50: 2.80 P75: 242.50 P99: 3968.75 P99.9: 5253.00 P99.99: 5253.00 ------------------------------------------------------ [ 0, 1 ] 49 22.791% 22.791% ##### ( 1, 2 ] 41 19.070% 41.860% #### ( 2, 3 ] 22 10.233% 52.093% ## ( 3, 4 ] 6 2.791% 54.884% # ( 4, 6 ] 8 3.721% 58.605% # ( 6, 10 ] 5 2.326% 60.930% ( 10, 15 ] 2 0.930% 61.860% ( 15, 22 ] 2 0.930% 62.791% ( 22, 34 ] 14 6.512% 69.302% # ( 110, 170 ] 5 2.326% 71.628% ( 170, 250 ] 8 3.721% 75.349% # ( 250, 380 ] 5 2.326% 77.674% ( 380, 580 ] 9 4.186% 81.860% # ( 580, 870 ] 11 5.116% 86.977% # ( 870, 1300 ] 8 3.721% 90.698% # ( 1300, 1900 ] 12 5.581% 96.279% # ( 1900, 2900 ] 3 1.395% 97.674% ( 2900, 4400 ] 4 1.860% 99.535% ( 4400, 6600 ] 1 0.465% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 942.5900 StdDev: 1090.34 Min: 80 Median: 430.0000 Max: 5248 Percentiles: P50: 430.00 P75: 1300.00 P99: 5248.00 P99.9: 5248.00 P99.99: 5248.00 ------------------------------------------------------ ( 76, 110 ] 7 7.000% 7.000% # ( 110, 170 ] 16 16.000% 23.000% ### ( 170, 250 ] 12 12.000% 35.000% ## ( 250, 380 ] 12 12.000% 47.000% ## ( 380, 580 ] 12 12.000% 59.000% ## ( 580, 870 ] 7 7.000% 66.000% # ( 870, 1300 ] 9 9.000% 75.000% ## ( 1300, 1900 ] 6 6.000% 81.000% # ( 1900, 2900 ] 11 11.000% 92.000% ## ( 2900, 4400 ] 6 6.000% 98.000% # ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 32.3 total, 8.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 213.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.761 H:M:S, 39.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 117.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.464 H:M:S, 65.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-10:35:03 ... thread 0: (1000000,8000000) ops and (320426.7,226919.1) ops/second in (3.120839,35.254861) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 3.37 GB 88.1 7.4 0.0 7.4 15.0 7.6 0.0 2.0 150.2 302.7 50.74 47.11 138 0.368 7738K 12K 0.0 0.0 L1 28/28 2.04 GB 0.0 5.6 4.1 1.5 5.5 4.0 0.1 1.4 221.1 218.5 25.77 24.11 4 6.442 5785K 67K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.1 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 14/0 927.52 MB 0.9 1.3 0.6 0.7 1.3 0.6 1.5 2.1 214.5 214.4 6.22 5.46 4 1.555 1335K 685 0.0 0.0 L4 168/0 9.76 GB 1.0 0.9 0.8 0.1 0.9 0.8 1.0 1.2 139.4 138.8 6.80 4.39 6 1.134 934K 4175 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/37 103.62 GB 0.0 15.3 5.5 9.8 22.8 13.0 6.3 3.0 174.6 259.8 89.97 81.49 153 0.588 15M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.3 5.5 9.8 22.8 13.0 6.3 3.0 174.6 259.8 89.97 81.49 153 0.588 15M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.3 5.5 9.8 15.3 5.4 0.0 0.0 232.1 230.8 67.71 62.05 39 1.736 15M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 348.1 22.26 19.44 114 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.5 total, 35.3 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.83 GB write, 659.42 MB/s write, 15.34 GB read, 443.24 MB/s read, 90.0 seconds Interval compaction: 22.83 GB write, 663.05 MB/s write, 15.34 GB read, 445.68 MB/s read, 90.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 24, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3283911 Average: 2.5268 StdDev: 15.78 Min: 0 Median: 1.4353 Max: 4420 Percentiles: P50: 1.44 P75: 1.83 P99: 6.19 P99.9: 136.26 P99.99: 293.67 ------------------------------------------------------ [ 0, 1 ] 725332 22.087% 22.087% #### ( 1, 2 ] 2105520 64.116% 86.204% ############# ( 2, 3 ] 241796 7.363% 93.567% # ( 3, 4 ] 110148 3.354% 96.921% # ( 4, 6 ] 67157 2.045% 98.966% ( 6, 10 ] 23532 0.717% 99.683% ( 10, 15 ] 2631 0.080% 99.763% ( 15, 22 ] 401 0.012% 99.775% ( 22, 34 ] 33 0.001% 99.776% ( 34, 51 ] 12 0.000% 99.776% ( 51, 76 ] 40 0.001% 99.777% ( 76, 110 ] 2625 0.080% 99.857% ( 110, 170 ] 3203 0.098% 99.955% ( 170, 250 ] 947 0.029% 99.984% ( 250, 380 ] 618 0.019% 100.003% ( 380, 580 ] 427 0.013% 100.016% ( 580, 870 ] 209 0.006% 100.022% ( 870, 1300 ] 53 0.002% 100.024% ( 1300, 1900 ] 30 0.001% 100.024% ( 1900, 2900 ] 22 0.001% 100.025% ( 2900, 4400 ] 16 0.000% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 688534 Average: 3.3551 StdDev: 36.53 Min: 0 Median: 1.5594 Max: 4713 Percentiles: P50: 1.56 P75: 1.97 P99: 8.80 P99.9: 206.11 P99.99: 1235.48 ------------------------------------------------------ [ 0, 1 ] 106921 15.529% 15.529% ### ( 1, 2 ] 424282 61.621% 77.150% ############ ( 2, 3 ] 75547 10.972% 88.122% ## ( 3, 4 ] 36792 5.344% 93.466% # ( 4, 6 ] 30670 4.454% 97.920% # ( 6, 10 ] 10605 1.540% 99.460% ( 10, 15 ] 1543 0.224% 99.684% ( 15, 22 ] 233 0.034% 99.718% ( 22, 34 ] 19 0.003% 99.721% ( 34, 51 ] 42 0.006% 99.727% ( 51, 76 ] 37 0.005% 99.732% ( 76, 110 ] 531 0.077% 99.809% ( 110, 170 ] 535 0.078% 99.887% ( 170, 250 ] 196 0.028% 99.916% ( 250, 380 ] 171 0.025% 99.940% ( 380, 580 ] 167 0.024% 99.965% ( 580, 870 ] 107 0.016% 99.980% ( 870, 1300 ] 79 0.011% 99.992% ( 1300, 1900 ] 49 0.007% 99.999% ( 1900, 2900 ] 34 0.005% 100.004% ( 2900, 4400 ] 22 0.003% 100.007% ( 4400, 6600 ] 5 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 28271 Average: 1.9424 StdDev: 2.83 Min: 1 Median: 1.3198 Max: 308 Percentiles: P50: 1.32 P75: 1.77 P99: 5.50 P99.9: 10.39 P99.99: 176.92 ------------------------------------------------------ [ 0, 1 ] 9136 32.316% 32.316% ###### ( 1, 2 ] 15631 55.290% 87.606% ########### ( 2, 3 ] 1707 6.038% 93.644% # ( 3, 4 ] 1010 3.573% 97.216% # ( 4, 6 ] 674 2.384% 99.600% ( 6, 10 ] 83 0.294% 99.894% ( 10, 15 ] 22 0.078% 99.972% ( 15, 22 ] 4 0.014% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 257429 Average: 6.8186 StdDev: 75.70 Min: 0 Median: 1.6448 Max: 5542 Percentiles: P50: 1.64 P75: 2.33 P99: 12.68 P99.9: 854.62 P99.99: 1718.81 ------------------------------------------------------ [ 0, 1 ] 33450 12.994% 12.994% ### ( 1, 2 ] 147732 57.387% 70.381% ########### ( 2, 3 ] 35892 13.942% 84.324% ### ( 3, 4 ] 18192 7.067% 91.391% # ( 4, 6 ] 13754 5.343% 96.733% # ( 6, 10 ] 5304 2.060% 98.794% ( 10, 15 ] 990 0.385% 99.178% ( 15, 22 ] 166 0.064% 99.243% ( 22, 34 ] 29 0.011% 99.254% ( 34, 51 ] 23 0.009% 99.263% ( 51, 76 ] 10 0.004% 99.267% ( 76, 110 ] 181 0.070% 99.337% ( 110, 170 ] 283 0.110% 99.447% ( 170, 250 ] 253 0.098% 99.546% ( 250, 380 ] 311 0.121% 99.666% ( 380, 580 ] 344 0.134% 99.800% ( 580, 870 ] 272 0.106% 99.906% ( 870, 1300 ] 167 0.065% 99.970% ( 1300, 1900 ] 72 0.028% 99.998% ( 1900, 2900 ] 42 0.016% 100.015% ( 2900, 4400 ] 41 0.016% 100.031% ( 4400, 6600 ] 4 0.002% 100.032% ** Level 4 read latency histogram (micros): Count: 215 Average: 334.4465 StdDev: 771.19 Min: 0 Median: 2.7955 Max: 5253 Percentiles: P50: 2.80 P75: 242.50 P99: 3968.75 P99.9: 5253.00 P99.99: 5253.00 ------------------------------------------------------ [ 0, 1 ] 49 22.791% 22.791% ##### ( 1, 2 ] 41 19.070% 41.860% #### ( 2, 3 ] 22 10.233% 52.093% ## ( 3, 4 ] 6 2.791% 54.884% # ( 4, 6 ] 8 3.721% 58.605% # ( 6, 10 ] 5 2.326% 60.930% ( 10, 15 ] 2 0.930% 61.860% ( 15, 22 ] 2 0.930% 62.791% ( 22, 34 ] 14 6.512% 69.302% # ( 110, 170 ] 5 2.326% 71.628% ( 170, 250 ] 8 3.721% 75.349% # ( 250, 380 ] 5 2.326% 77.674% ( 380, 580 ] 9 4.186% 81.860% # ( 580, 870 ] 11 5.116% 86.977% # ( 870, 1300 ] 8 3.721% 90.698% # ( 1300, 1900 ] 12 5.581% 96.279% # ( 1900, 2900 ] 3 1.395% 97.674% ( 2900, 4400 ] 4 1.860% 99.535% ( 4400, 6600 ] 1 0.465% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 942.5900 StdDev: 1090.34 Min: 80 Median: 430.0000 Max: 5248 Percentiles: P50: 430.00 P75: 1300.00 P99: 5248.00 P99.9: 5248.00 P99.99: 5248.00 ------------------------------------------------------ ( 76, 110 ] 7 7.000% 7.000% # ( 110, 170 ] 16 16.000% 23.000% ### ( 170, 250 ] 12 12.000% 35.000% ## ( 250, 380 ] 12 12.000% 47.000% ## ( 380, 580 ] 12 12.000% 59.000% ## ( 580, 870 ] 7 7.000% 66.000% # ( 870, 1300 ] 9 9.000% 75.000% ## ( 1300, 1900 ] 6 6.000% 81.000% # ( 1900, 2900 ] 11 11.000% 92.000% ## ( 2900, 4400 ] 6 6.000% 98.000% # ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 35.5 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 222.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.200 H:M:S, 37.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.439 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-10:35:22 ... thread 0: (1000000,9000000) ops and (51591.6,164720.9) ops/second in (19.382999,54.637860) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 2.08 GB 18.9 9.7 0.0 9.7 18.2 8.5 0.0 2.1 150.4 281.4 66.17 58.44 154 0.430 10M 22K 0.0 0.0 L1 2/2 228.34 MB 0.0 9.8 6.3 3.5 9.7 6.1 0.1 1.5 223.2 220.3 45.01 41.85 5 9.002 8561K 67K 0.0 0.0 L2 1/0 128.78 MB 1.3 0.1 0.1 0.0 0.1 0.1 6.0 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 37/9 2.97 GB 2.0 3.3 1.7 1.6 3.2 1.6 4.3 1.9 131.2 130.3 25.45 14.64 14 1.818 3240K 21K 0.0 0.0 L4 184/20 11.50 GB 1.1 2.9 2.5 0.4 2.9 2.5 1.0 1.1 139.4 138.7 21.27 13.65 23 0.925 2981K 14K 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/35 104.44 GB 0.0 25.8 10.5 15.3 34.1 18.8 13.1 4.0 166.8 220.5 158.34 129.00 197 0.804 24M 126K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.8 10.5 15.3 34.1 18.8 13.1 4.0 166.8 220.5 158.34 129.00 197 0.804 24M 126K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.8 10.5 15.3 25.6 10.3 0.0 0.0 201.3 199.9 131.19 106.97 71 1.848 24M 126K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 320.2 27.15 22.03 126 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.8 total, 54.6 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.09 GB write, 636.72 MB/s write, 25.79 GB read, 481.66 MB/s read, 158.3 seconds Interval compaction: 34.09 GB write, 638.98 MB/s write, 25.79 GB read, 483.37 MB/s read, 158.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 28, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4232004 Average: 2.8959 StdDev: 26.23 Min: 0 Median: 1.4416 Max: 7865 Percentiles: P50: 1.44 P75: 1.84 P99: 7.60 P99.9: 162.30 P99.99: 436.62 ------------------------------------------------------ [ 0, 1 ] 931047 22.000% 22.000% #### ( 1, 2 ] 2683210 63.403% 85.403% ############# ( 2, 3 ] 315720 7.460% 92.863% # ( 3, 4 ] 146754 3.468% 96.331% # ( 4, 6 ] 98452 2.326% 98.657% ( 6, 10 ] 36235 0.856% 99.514% ( 10, 15 ] 4060 0.096% 99.609% ( 15, 22 ] 642 0.015% 99.625% ( 22, 34 ] 41 0.001% 99.626% ( 34, 51 ] 72 0.002% 99.627% ( 51, 76 ] 136 0.003% 99.631% ( 76, 110 ] 6008 0.142% 99.773% ( 110, 170 ] 6191 0.146% 99.919% ( 170, 250 ] 1690 0.040% 99.959% ( 250, 380 ] 1084 0.026% 99.984% ( 380, 580 ] 847 0.020% 100.004% ( 580, 870 ] 420 0.010% 100.014% ( 870, 1300 ] 143 0.003% 100.018% ( 1300, 1900 ] 62 0.001% 100.019% ( 1900, 2900 ] 81 0.002% 100.021% ( 2900, 4400 ] 67 0.002% 100.023% ( 4400, 6600 ] 21 0.000% 100.023% ( 6600, 9900 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1958245 Average: 5.3241 StdDev: 89.36 Min: 0 Median: 1.6150 Max: 10266 Percentiles: P50: 1.62 P75: 2.26 P99: 9.33 P99.9: 165.69 P99.99: 500.29 ------------------------------------------------------ [ 0, 1 ] 298900 15.264% 15.264% ### ( 1, 2 ] 1106032 56.481% 71.744% ########### ( 2, 3 ] 246819 12.604% 84.349% ### ( 3, 4 ] 129353 6.606% 90.954% # ( 4, 6 ] 126293 6.449% 97.403% # ( 6, 10 ] 37525 1.916% 99.320% ( 10, 15 ] 6729 0.344% 99.663% ( 15, 22 ] 924 0.047% 99.710% ( 22, 34 ] 67 0.003% 99.714% ( 34, 51 ] 60 0.003% 99.717% ( 51, 76 ] 172 0.009% 99.726% ( 76, 110 ] 1927 0.098% 99.824% ( 110, 170 ] 1604 0.082% 99.906% ( 170, 250 ] 650 0.033% 99.939% ( 250, 380 ] 599 0.031% 99.970% ( 380, 580 ] 662 0.034% 100.004% ( 580, 870 ] 585 0.030% 100.033% ( 870, 1300 ] 396 0.020% 100.054% ( 1300, 1900 ] 232 0.012% 100.066% ( 1900, 2900 ] 276 0.014% 100.080% ( 2900, 4400 ] 467 0.024% 100.104% ( 4400, 6600 ] 134 0.007% 100.110% ( 6600, 9900 ] 48 0.002% 100.113% ( 9900, 14000 ] 2 0.000% 100.113% ** Level 2 read latency histogram (micros): Count: 28271 Average: 1.9424 StdDev: 2.83 Min: 1 Median: 1.3198 Max: 308 Percentiles: P50: 1.32 P75: 1.77 P99: 5.50 P99.9: 10.39 P99.99: 176.92 ------------------------------------------------------ [ 0, 1 ] 9136 32.316% 32.316% ###### ( 1, 2 ] 15631 55.290% 87.606% ########### ( 2, 3 ] 1707 6.038% 93.644% # ( 3, 4 ] 1010 3.573% 97.216% # ( 4, 6 ] 674 2.384% 99.600% ( 6, 10 ] 83 0.294% 99.894% ( 10, 15 ] 22 0.078% 99.972% ( 15, 22 ] 4 0.014% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 627650 Average: 7.2671 StdDev: 91.57 Min: 0 Median: 1.8063 Max: 7691 Percentiles: P50: 1.81 P75: 2.84 P99: 9.64 P99.9: 479.79 P99.99: 705.54 ------------------------------------------------------ [ 0, 1 ] 44543 7.097% 7.097% # ( 1, 2 ] 333980 53.211% 60.308% ########### ( 2, 3 ] 109745 17.485% 77.793% ### ( 3, 4 ] 62970 10.033% 87.826% ## ( 4, 6 ] 58403 9.305% 97.131% ## ( 6, 10 ] 12904 2.056% 99.187% ( 10, 15 ] 2347 0.374% 99.561% ( 15, 22 ] 312 0.050% 99.610% ( 22, 34 ] 41 0.007% 99.617% ( 34, 51 ] 30 0.005% 99.622% ( 51, 76 ] 37 0.006% 99.627% ( 76, 110 ] 204 0.033% 99.660% ( 110, 170 ] 330 0.053% 99.713% ( 170, 250 ] 358 0.057% 99.770% ( 250, 380 ] 508 0.081% 99.851% ( 380, 580 ] 622 0.099% 99.950% ( 580, 870 ] 585 0.093% 100.043% ( 870, 1300 ] 427 0.068% 100.111% ( 1300, 1900 ] 187 0.030% 100.141% ( 1900, 2900 ] 165 0.026% 100.167% ( 2900, 4400 ] 148 0.024% 100.191% ( 4400, 6600 ] 24 0.004% 100.194% ( 6600, 9900 ] 7 0.001% 100.195% ** Level 4 read latency histogram (micros): Count: 38330 Average: 32.8795 StdDev: 240.05 Min: 0 Median: 1.8691 Max: 6340 Percentiles: P50: 1.87 P75: 3.00 P99: 943.82 P99.9: 3532.43 P99.99: 4293.39 ------------------------------------------------------ [ 0, 1 ] 1846 4.816% 4.816% # ( 1, 2 ] 19928 51.991% 56.807% ########## ( 2, 3 ] 6978 18.205% 75.012% #### ( 3, 4 ] 4270 11.140% 86.152% ## ( 4, 6 ] 3183 8.304% 94.456% ## ( 6, 10 ] 754 1.967% 96.423% ( 10, 15 ] 176 0.459% 96.882% ( 15, 22 ] 23 0.060% 96.942% ( 22, 34 ] 20 0.052% 96.995% ( 34, 51 ] 5 0.013% 97.008% ( 51, 76 ] 3 0.008% 97.015% ( 76, 110 ] 15 0.039% 97.055% ( 110, 170 ] 61 0.159% 97.214% ( 170, 250 ] 105 0.274% 97.488% ( 250, 380 ] 108 0.282% 97.769% ( 380, 580 ] 204 0.532% 98.302% ( 580, 870 ] 238 0.621% 98.923% ( 870, 1300 ] 173 0.451% 99.374% ( 1300, 1900 ] 92 0.240% 99.614% ( 1900, 2900 ] 81 0.211% 99.825% ( 2900, 4400 ] 68 0.177% 100.003% ( 4400, 6600 ] 12 0.031% 100.034% ** Level 5 read latency histogram (micros): Count: 100 Average: 942.5900 StdDev: 1090.34 Min: 80 Median: 430.0000 Max: 5248 Percentiles: P50: 430.00 P75: 1300.00 P99: 5248.00 P99.9: 5248.00 P99.99: 5248.00 ------------------------------------------------------ ( 76, 110 ] 7 7.000% 7.000% # ( 110, 170 ] 16 16.000% 23.000% ### ( 170, 250 ] 12 12.000% 35.000% ## ( 250, 380 ] 12 12.000% 47.000% ## ( 380, 580 ] 12 12.000% 59.000% ## ( 580, 870 ] 7 7.000% 66.000% # ( 870, 1300 ] 9 9.000% 75.000% ## ( 1300, 1900 ] 6 6.000% 81.000% # ( 1900, 2900 ] 11 11.000% 92.000% ## ( 2900, 4400 ] 6 6.000% 98.000% # ( 4400, 6600 ] 2 2.000% 100.000% ** DB Stats ** Uptime(secs): 54.8 total, 19.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 161.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.167 H:M:S, 53.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 50.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:15.967 H:M:S, 82.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/27-10:35:27 ... thread 0: (1000000,10000000) ops and (214366.6,168626.2) ops/second in (4.664905,59.302765) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 3.06 GB 88.1 10.4 0.0 10.4 19.8 9.5 0.0 2.1 144.9 276.6 73.47 63.76 169 0.435 10M 23K 0.0 0.0 L1 2/2 228.34 MB 0.0 9.8 6.3 3.5 9.7 6.1 0.1 1.5 223.2 220.3 45.01 41.85 5 9.002 8561K 67K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 6.0 1.8 252.1 252.0 0.44 0.42 1 0.442 113K 34 0.0 0.0 L3 18/0 978.03 MB 1.0 3.5 1.8 1.7 3.4 1.8 4.3 1.9 132.6 131.8 26.77 15.61 15 1.784 3454K 21K 0.0 0.0 L4 156/0 9.63 GB 1.0 5.8 4.5 1.3 5.7 4.5 1.2 1.3 127.5 126.9 46.27 27.27 40 1.157 5962K 27K 0.0 0.0 L5 1112/0 91.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/10 105.41 GB 0.0 29.5 12.6 16.9 38.8 21.9 17.3 4.1 157.6 207.1 191.95 148.91 230 0.835 28M 139K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.5 12.6 16.9 38.8 21.9 17.3 4.1 157.6 207.1 191.95 148.91 230 0.835 28M 139K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.5 12.6 16.9 29.3 12.4 0.0 0.0 188.6 187.4 160.35 124.21 91 1.762 28M 139K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 307.0 31.60 24.70 139 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.5 total, 59.3 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.81 GB write, 668.02 MB/s write, 29.54 GB read, 508.42 MB/s read, 192.0 seconds Interval compaction: 38.81 GB write, 670.21 MB/s write, 29.54 GB read, 510.08 MB/s read, 192.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 48, interval: 94 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4671957 Average: 2.9952 StdDev: 30.95 Min: 0 Median: 1.4635 Max: 7865 Percentiles: P50: 1.46 P75: 1.86 P99: 7.80 P99.9: 160.62 P99.99: 465.11 ------------------------------------------------------ [ 0, 1 ] 972804 20.822% 20.822% #### ( 1, 2 ] 2941146 62.953% 83.775% ############# ( 2, 3 ] 384653 8.233% 92.009% ## ( 3, 4 ] 176506 3.778% 95.787% # ( 4, 6 ] 130344 2.790% 98.577% # ( 6, 10 ] 44064 0.943% 99.520% ( 10, 15 ] 5445 0.117% 99.636% ( 15, 22 ] 812 0.017% 99.654% ( 22, 34 ] 45 0.001% 99.655% ( 34, 51 ] 77 0.002% 99.656% ( 51, 76 ] 138 0.003% 99.659% ( 76, 110 ] 6016 0.129% 99.788% ( 110, 170 ] 6207 0.133% 99.921% ( 170, 250 ] 1719 0.037% 99.958% ( 250, 380 ] 1126 0.024% 99.982% ( 380, 580 ] 916 0.020% 100.001% ( 580, 870 ] 493 0.011% 100.012% ( 870, 1300 ] 194 0.004% 100.016% ( 1300, 1900 ] 91 0.002% 100.018% ( 1900, 2900 ] 141 0.003% 100.021% ( 2900, 4400 ] 122 0.003% 100.024% ( 4400, 6600 ] 32 0.001% 100.024% ( 6600, 9900 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 2297776 Average: 6.2846 StdDev: 103.74 Min: 0 Median: 1.6608 Max: 12088 Percentiles: P50: 1.66 P75: 2.44 P99: 9.53 P99.9: 242.32 P99.99: 739.97 ------------------------------------------------------ [ 0, 1 ] 306328 13.331% 13.331% ### ( 1, 2 ] 1275009 55.489% 68.820% ########### ( 2, 3 ] 319437 13.902% 82.722% ### ( 3, 4 ] 166420 7.243% 89.965% # ( 4, 6 ] 166215 7.234% 97.199% # ( 6, 10 ] 46953 2.043% 99.242% ( 10, 15 ] 9373 0.408% 99.650% ( 15, 22 ] 1257 0.055% 99.705% ( 22, 34 ] 88 0.004% 99.709% ( 34, 51 ] 64 0.003% 99.711% ( 51, 76 ] 172 0.007% 99.719% ( 76, 110 ] 1928 0.084% 99.803% ( 110, 170 ] 1615 0.070% 99.873% ( 170, 250 ] 685 0.030% 99.903% ( 250, 380 ] 683 0.030% 99.933% ( 380, 580 ] 852 0.037% 99.970% ( 580, 870 ] 847 0.037% 100.007% ( 870, 1300 ] 627 0.027% 100.034% ( 1300, 1900 ] 386 0.017% 100.051% ( 1900, 2900 ] 519 0.023% 100.073% ( 2900, 4400 ] 771 0.034% 100.107% ( 4400, 6600 ] 222 0.010% 100.116% ( 6600, 9900 ] 60 0.003% 100.119% ( 9900, 14000 ] 3 0.000% 100.119% ** Level 2 read latency histogram (micros): Count: 28271 Average: 1.9424 StdDev: 2.83 Min: 1 Median: 1.3198 Max: 308 Percentiles: P50: 1.32 P75: 1.77 P99: 5.50 P99.9: 10.39 P99.99: 176.92 ------------------------------------------------------ [ 0, 1 ] 9136 32.316% 32.316% ###### ( 1, 2 ] 15631 55.290% 87.606% ########### ( 2, 3 ] 1707 6.038% 93.644% # ( 3, 4 ] 1010 3.573% 97.216% # ( 4, 6 ] 674 2.384% 99.600% ( 6, 10 ] 83 0.294% 99.894% ( 10, 15 ] 22 0.078% 99.972% ( 15, 22 ] 4 0.014% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 750122 Average: 8.3748 StdDev: 108.20 Min: 0 Median: 1.8241 Max: 7691 Percentiles: P50: 1.82 P75: 2.88 P99: 9.86 P99.9: 650.04 P99.99: 933.98 ------------------------------------------------------ [ 0, 1 ] 48099 6.412% 6.412% # ( 1, 2 ] 396768 52.894% 59.306% ########### ( 2, 3 ] 134204 17.891% 77.197% #### ( 3, 4 ] 76385 10.183% 87.380% ## ( 4, 6 ] 71859 9.580% 96.960% ## ( 6, 10 ] 15867 2.115% 99.075% ( 10, 15 ] 3155 0.421% 99.495% ( 15, 22 ] 418 0.056% 99.551% ( 22, 34 ] 47 0.006% 99.557% ( 34, 51 ] 30 0.004% 99.561% ( 51, 76 ] 39 0.005% 99.567% ( 76, 110 ] 206 0.027% 99.594% ( 110, 170 ] 354 0.047% 99.641% ( 170, 250 ] 404 0.054% 99.695% ( 250, 380 ] 576 0.077% 99.772% ( 380, 580 ] 772 0.103% 99.875% ( 580, 870 ] 782 0.104% 99.979% ( 870, 1300 ] 551 0.073% 100.053% ( 1300, 1900 ] 270 0.036% 100.089% ( 1900, 2900 ] 276 0.037% 100.125% ( 2900, 4400 ] 272 0.036% 100.162% ( 4400, 6600 ] 44 0.006% 100.167% ( 6600, 9900 ] 12 0.002% 100.169% ** Level 4 read latency histogram (micros): Count: 232911 Average: 16.1231 StdDev: 172.37 Min: 0 Median: 1.9143 Max: 7158 Percentiles: P50: 1.91 P75: 3.05 P99: 112.19 P99.9: 2197.33 P99.99: 3217.67 ------------------------------------------------------ [ 0, 1 ] 7024 3.016% 3.016% # ( 1, 2 ] 119692 51.390% 54.405% ########## ( 2, 3 ] 46642 20.026% 74.431% #### ( 3, 4 ] 25379 10.896% 85.327% ## ( 4, 6 ] 25016 10.741% 96.068% ## ( 6, 10 ] 5228 2.245% 98.313% ( 10, 15 ] 1343 0.577% 98.889% ( 15, 22 ] 189 0.081% 98.970% ( 22, 34 ] 33 0.014% 98.985% ( 34, 51 ] 8 0.003% 98.988% ( 51, 76 ] 5 0.002% 98.990% ( 76, 110 ] 20 0.009% 98.999% ( 110, 170 ] 79 0.034% 99.033% ( 170, 250 ] 195 0.084% 99.116% ( 250, 380 ] 214 0.092% 99.208% ( 380, 580 ] 404 0.173% 99.382% ( 580, 870 ] 484 0.208% 99.590% ( 870, 1300 ] 427 0.183% 99.773% ( 1300, 1900 ] 228 0.098% 99.871% ( 1900, 2900 ] 229 0.098% 99.969% ( 2900, 4400 ] 230 0.099% 100.068% ( 4400, 6600 ] 44 0.019% 100.087% ( 6600, 9900 ] 2 0.001% 100.088% ** Level 5 read latency histogram (micros): Count: 340 Average: 1486.1471 StdDev: 1441.49 Min: 80 Median: 890.4762 Max: 7118 Percentiles: P50: 890.48 P75: 2304.76 P99: 6248.00 P99.9: 7118.00 P99.99: 7118.00 ------------------------------------------------------ ( 76, 110 ] 7 2.059% 2.059% ( 110, 170 ] 18 5.294% 7.353% # ( 170, 250 ] 22 6.471% 13.824% # ( 250, 380 ] 32 9.412% 23.235% ## ( 380, 580 ] 46 13.529% 36.765% ### ( 580, 870 ] 43 12.647% 49.412% ### ( 870, 1300 ] 42 12.353% 61.765% ## ( 1300, 1900 ] 28 8.235% 70.000% ## ( 1900, 2900 ] 42 12.353% 82.353% ## ( 2900, 4400 ] 44 12.941% 95.294% ### ( 4400, 6600 ] 15 4.412% 99.706% # ( 6600, 9900 ] 1 0.294% 100.000% ** DB Stats ** Uptime(secs): 59.5 total, 4.7 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 165.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:31.031 H:M:S, 52.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 210.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.864 H:M:S, 40.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.874 micros/op 170239 ops/sec 60.145 seconds 10238999 operations; 165.0 MB/s Microseconds per write: Count: 10238999 Average: 5.8741 StdDev: 483.92 Min: 1 Median: 1.7836 Max: 815016 Percentiles: P50: 1.78 P75: 2.83 P99: 9.42 P99.9: 1135.89 P99.99: 2658.46 ------------------------------------------------------ [ 0, 1 ] 1115098 10.891% 10.891% ## ( 1, 2 ] 5110107 49.908% 60.799% ########## ( 2, 3 ] 1755752 17.148% 77.947% ### ( 3, 4 ] 1442982 14.093% 92.040% ### ( 4, 6 ] 601636 5.876% 97.916% # ( 6, 10 ] 129796 1.268% 99.183% ( 10, 15 ] 41492 0.405% 99.588% ( 15, 22 ] 9168 0.090% 99.678% ( 22, 34 ] 1829 0.018% 99.696% ( 34, 51 ] 255 0.002% 99.698% ( 51, 76 ] 27 0.000% 99.699% ( 76, 110 ] 6974 0.068% 99.767% ( 110, 170 ] 2955 0.029% 99.796% ( 170, 250 ] 293 0.003% 99.798% ( 250, 380 ] 175 0.002% 99.800% ( 380, 580 ] 28 0.000% 99.800% ( 580, 870 ] 28 0.000% 99.801% ( 870, 1300 ] 16439 0.161% 99.961% ( 1300, 1900 ] 62 0.001% 99.962% ( 1900, 2900 ] 3796 0.037% 99.999% ( 2900, 4400 ] 71 0.001% 100.000% ( 4400, 6600 ] 12 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 10 0.000% 100.000% ( 380000, 570000 ] 3 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 211603 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10238999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10566646968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 604 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31226149 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 33552948502 rocksdb.compact.write.bytes COUNT : 33336737594 rocksdb.flush.write.bytes COUNT : 10503287219 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 79 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 288 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10418422784 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3878912 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33660270227 rocksdb.non.last.level.read.count COUNT : 8129405 rocksdb.block.checksum.compute.count COUNT : 8128277 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.423143 P95 : 3.946401 P99 : 7.910997 P100 : 815013.000000 COUNT : 10238999 SUM : 55022991 rocksdb.compaction.times.micros P50 : 1160000.000000 P95 : 3880000.000000 P99 : 18320000.000000 P100 : 19242272.000000 COUNT : 92 SUM : 161556900 rocksdb.compaction.times.cpu_micros P50 : 923255.813953 P95 : 3880000.000000 P99 : 17740811.000000 P100 : 17740811.000000 COUNT : 92 SUM : 125387184 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 710.815217 P95 : 9405.000000 P99 : 144200.000000 P100 : 222695.000000 COUNT : 143 SUM : 616142 rocksdb.compaction.outfile.sync.micros P50 : 1174.909091 P95 : 192666.666667 P99 : 502075.000000 P100 : 919048.000000 COUNT : 386 SUM : 11441596 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 107.080808 P95 : 2191.666667 P99 : 5692.500000 P100 : 6707.000000 COUNT : 265 SUM : 116716 rocksdb.table.open.io.micros P50 : 1593.181818 P95 : 8812.941176 P99 : 13987.384615 P100 : 17785.000000 COUNT : 604 SUM : 1468529 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.612027 P95 : 8.011161 P99 : 12.554761 P100 : 12096.000000 COUNT : 8126697 SUM : 55976593 rocksdb.read.block.get.micros P50 : 483.773585 P95 : 3748.571429 P99 : 5976.960000 P100 : 8611.000000 COUNT : 1208 SUM : 1167417 rocksdb.write.raw.block.micros P50 : 0.513570 P95 : 0.975782 P99 : 2.911937 P100 : 16885.000000 COUNT : 10618630 SUM : 22706466 rocksdb.numfiles.in.singlecompaction P50 : 3.291667 P95 : 4.866667 P99 : 24.760000 P100 : 33.000000 COUNT : 154 SUM : 610 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558887 P95 : 1148.181006 P99 : 2407.531027 P100 : 814823.000000 COUNT : 194098 SUM : 31244243 rocksdb.sst.read.micros P50 : 1.558984 P95 : 4.831250 P99 : 9.133400 P100 : 12088.000000 COUNT : 8129875 SUM : 39519059 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10238999 SUM : 10566646968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 206956.521739 P95 : 497166.666667 P99 : 1037933.333333 P100 : 1199123.000000 COUNT : 143 SUM : 32476257 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 387 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0