[2024-12-07 15:17:15.789824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-12-07 15:17:15.790096] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid463967 ] Set seed to 1733581035783203 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-07 15:17:15.886064] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-07 15:17:15.922879] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-07 15:17:15.922928] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 463967' to capture a snapshot of events at runtime. [2024-12-07 15:17:15.922940] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid463967 for offline analysis/debug. [2024-12-07 15:17:15.922969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 7 15:17:20 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/07-15:17:29 ... thread 0: (1000000,1000000) ops and (107562.7,107562.7) ops/second in (9.296904,9.296904) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 692.90 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 118.2 7.46 2.60 10 0.746 0 0 0.0 0.0 L1 3/3 130.04 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 1.5 116.1 116.0 3.50 1.83 2 1.751 412K 232 0.0 0.0 L2 14/12 1.62 GB 1.3 0.1 0.1 0.0 0.1 0.1 0.0 1.0 146.1 146.1 0.93 0.63 1 0.931 138K 0 0.0 0.0 L3 35/8 2.50 GB 1.9 3.5 2.5 1.0 3.4 2.4 0.1 1.4 99.6 98.5 35.65 16.50 20 1.782 1221K 0 0.0 0.0 L4 212/13 12.38 GB 1.2 3.8 2.7 1.1 3.7 2.6 0.1 1.4 116.8 115.4 32.90 17.72 28 1.175 2538K 6905 0.0 0.0 L5 1076/0 88.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1348/43 105.89 GB 0.0 7.7 5.5 2.3 8.5 6.3 0.2 9.9 98.6 108.6 80.44 39.28 61 1.319 4310K 7137 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 5.5 2.3 8.5 6.3 0.2 9.9 98.6 108.6 80.44 39.28 61 1.319 4310K 7137 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 5.5 2.3 7.7 5.4 0.0 0.0 108.7 107.6 72.98 36.68 51 1.431 4310K 7137 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 118.2 7.46 2.60 10 0.746 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.5 total, 9.3 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.53 GB write, 920.11 MB/s write, 7.75 GB read, 836.09 MB/s read, 80.4 seconds Interval compaction: 8.53 GB write, 939.09 MB/s write, 7.75 GB read, 853.34 MB/s read, 80.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 27, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 190163 Average: 11.1447 StdDev: 144.92 Min: 1 Median: 1.8269 Max: 12094 Percentiles: P50: 1.83 P75: 2.89 P99: 9.99 P99.9: 2422.26 P99.99: 4798.91 ------------------------------------------------------ [ 0, 1 ] 11883 6.249% 6.249% # ( 1, 2 ] 100620 52.913% 59.161% ########### ( 2, 3 ] 33889 17.821% 76.982% #### ( 3, 4 ] 19329 10.164% 87.147% ## ( 4, 6 ] 18847 9.911% 97.058% ## ( 6, 10 ] 3706 1.949% 99.007% ( 10, 15 ] 739 0.389% 99.395% ( 15, 22 ] 100 0.053% 99.448% ( 22, 34 ] 14 0.007% 99.455% ( 34, 51 ] 4 0.002% 99.457% ( 51, 76 ] 1 0.001% 99.458% ( 76, 110 ] 1 0.001% 99.458% ( 110, 170 ] 5 0.003% 99.461% ( 170, 250 ] 15 0.008% 99.469% ( 250, 380 ] 45 0.024% 99.493% ( 380, 580 ] 105 0.055% 99.548% ( 580, 870 ] 211 0.111% 99.659% ( 870, 1300 ] 241 0.127% 99.785% ( 1300, 1900 ] 163 0.086% 99.871% ( 1900, 2900 ] 105 0.055% 99.926% ( 2900, 4400 ] 115 0.060% 99.987% ( 4400, 6600 ] 33 0.017% 100.004% ( 6600, 9900 ] 3 0.002% 100.006% ( 9900, 14000 ] 1 0.001% 100.006% ** Level 1 read latency histogram (micros): Count: 103349 Average: 7.3214 StdDev: 102.06 Min: 1 Median: 1.8959 Max: 5724 Percentiles: P50: 1.90 P75: 3.06 P99: 9.56 P99.9: 1468.68 P99.99: 4385.22 ------------------------------------------------------ [ 0, 1 ] 4299 4.160% 4.160% # ( 1, 2 ] 52880 51.166% 55.326% ########## ( 2, 3 ] 19636 19.000% 74.326% #### ( 3, 4 ] 11622 11.245% 85.571% ## ( 4, 6 ] 12025 11.635% 97.207% ## ( 6, 10 ] 2082 2.015% 99.221% ( 10, 15 ] 415 0.402% 99.623% ( 15, 22 ] 53 0.051% 99.674% ( 22, 34 ] 9 0.009% 99.683% ( 34, 51 ] 6 0.006% 99.688% ( 51, 76 ] 4 0.004% 99.692% ( 76, 110 ] 2 0.002% 99.694% ( 110, 170 ] 2 0.002% 99.696% ( 170, 250 ] 6 0.006% 99.702% ( 250, 380 ] 7 0.007% 99.709% ( 380, 580 ] 41 0.040% 99.748% ( 580, 870 ] 78 0.075% 99.824% ( 870, 1300 ] 66 0.064% 99.888% ( 1300, 1900 ] 45 0.044% 99.931% ( 1900, 2900 ] 27 0.026% 99.957% ( 2900, 4400 ] 34 0.033% 99.990% ( 4400, 6600 ] 10 0.010% 100.000% ** Level 2 read latency histogram (micros): Count: 821637 Average: 14.7476 StdDev: 181.80 Min: 1 Median: 1.9050 Max: 22550 Percentiles: P50: 1.91 P75: 3.03 P99: 12.93 P99.9: 1840.85 P99.99: 2713.38 ------------------------------------------------------ [ 0, 1 ] 35995 4.381% 4.381% # ( 1, 2 ] 414160 50.407% 54.788% ########## ( 2, 3 ] 163562 19.907% 74.694% #### ( 3, 4 ] 88211 10.736% 85.430% ## ( 4, 6 ] 86834 10.568% 95.999% ## ( 6, 10 ] 21425 2.608% 98.606% # ( 10, 15 ] 5524 0.672% 99.279% ( 15, 22 ] 744 0.091% 99.369% ( 22, 34 ] 109 0.013% 99.383% ( 34, 51 ] 70 0.009% 99.391% ( 51, 76 ] 74 0.009% 99.400% ( 76, 110 ] 31 0.004% 99.404% ( 110, 170 ] 86 0.010% 99.414% ( 170, 250 ] 165 0.020% 99.434% ( 250, 380 ] 354 0.043% 99.478% ( 380, 580 ] 677 0.082% 99.560% ( 580, 870 ] 988 0.120% 99.680% ( 870, 1300 ] 1070 0.130% 99.810% ( 1300, 1900 ] 818 0.100% 99.910% ( 1900, 2900 ] 810 0.099% 100.009% ( 2900, 4400 ] 734 0.089% 100.098% ( 4400, 6600 ] 237 0.029% 100.127% ( 6600, 9900 ] 47 0.006% 100.132% ( 14000, 22000 ] 1 0.000% 100.133% ( 22000, 33000 ] 1 0.000% 100.133% ** Level 3 read latency histogram (micros): Count: 903211 Average: 11.0497 StdDev: 145.54 Min: 1 Median: 1.9167 Max: 10774 Percentiles: P50: 1.92 P75: 3.04 P99: 9.97 P99.9: 1126.67 P99.99: 1776.66 ------------------------------------------------------ [ 0, 1 ] 31014 3.434% 3.434% # ( 1, 2 ] 458824 50.799% 54.233% ########## ( 2, 3 ] 183239 20.288% 74.520% #### ( 3, 4 ] 100426 11.119% 85.639% ## ( 4, 6 ] 100112 11.084% 96.723% ## ( 6, 10 ] 20696 2.291% 99.015% ( 10, 15 ] 4720 0.523% 99.537% ( 15, 22 ] 578 0.064% 99.601% ( 22, 34 ] 62 0.007% 99.608% ( 34, 51 ] 77 0.009% 99.617% ( 51, 76 ] 82 0.009% 99.626% ( 76, 110 ] 25 0.003% 99.628% ( 110, 170 ] 63 0.007% 99.635% ( 170, 250 ] 115 0.013% 99.648% ( 250, 380 ] 233 0.026% 99.674% ( 380, 580 ] 562 0.062% 99.736% ( 580, 870 ] 938 0.104% 99.840% ( 870, 1300 ] 911 0.101% 99.941% ( 1300, 1900 ] 561 0.062% 100.003% ( 1900, 2900 ] 598 0.066% 100.069% ( 2900, 4400 ] 584 0.065% 100.134% ( 4400, 6600 ] 151 0.017% 100.151% ( 6600, 9900 ] 23 0.003% 100.153% ( 9900, 14000 ] 1 0.000% 100.153% ** Level 4 read latency histogram (micros): Count: 356343 Average: 25.9705 StdDev: 238.60 Min: 1 Median: 1.9144 Max: 13946 Percentiles: P50: 1.91 P75: 3.10 P99: 729.11 P99.9: 3183.95 P99.99: 4022.04 ------------------------------------------------------ [ 0, 1 ] 12888 3.617% 3.617% # ( 1, 2 ] 180753 50.724% 54.341% ########## ( 2, 3 ] 69561 19.521% 73.862% #### ( 3, 4 ] 39459 11.073% 84.935% ## ( 4, 6 ] 38069 10.683% 95.619% ## ( 6, 10 ] 8168 2.292% 97.911% ( 10, 15 ] 1709 0.480% 98.390% ( 15, 22 ] 219 0.061% 98.452% ( 22, 34 ] 23 0.006% 98.458% ( 34, 51 ] 44 0.012% 98.471% ( 51, 76 ] 40 0.011% 98.482% ( 76, 110 ] 24 0.007% 98.489% ( 110, 170 ] 57 0.016% 98.505% ( 170, 250 ] 142 0.040% 98.544% ( 250, 380 ] 361 0.101% 98.646% ( 380, 580 ] 698 0.196% 98.842% ( 580, 870 ] 1098 0.308% 99.150% ( 870, 1300 ] 1213 0.340% 99.490% ( 1300, 1900 ] 752 0.211% 99.701% ( 1900, 2900 ] 600 0.168% 99.870% ( 2900, 4400 ] 574 0.161% 100.031% ( 4400, 6600 ] 165 0.046% 100.077% ( 6600, 9900 ] 25 0.007% 100.084% ( 9900, 14000 ] 1 0.000% 100.084% ** Level 5 read latency histogram (micros): Count: 16644 Average: 1627.8166 StdDev: 1416.85 Min: 90 Median: 1122.4542 Max: 18067 Percentiles: P50: 1122.45 P75: 2233.51 P99: 6483.71 P99.9: 9709.35 P99.99: 18067.00 ------------------------------------------------------ ( 76, 110 ] 12 0.072% 0.072% ( 110, 170 ] 88 0.529% 0.601% ( 170, 250 ] 310 1.863% 2.463% ( 250, 380 ] 910 5.467% 7.931% # ( 380, 580 ] 1964 11.800% 19.731% ## ( 580, 870 ] 3117 18.727% 38.458% #### ( 870, 1300 ] 3272 19.659% 58.117% #### ( 1300, 1900 ] 2187 13.140% 71.257% ### ( 1900, 2900 ] 1868 11.223% 82.480% ## ( 2900, 4400 ] 2007 12.058% 94.539% ## ( 4400, 6600 ] 784 4.710% 99.249% # ( 6600, 9900 ] 115 0.691% 99.940% ( 9900, 14000 ] 5 0.030% 99.970% ( 14000, 22000 ] 6 0.036% 100.006% ** DB Stats ** Uptime(secs): 9.5 total, 9.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 103.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.225 H:M:S, 55.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 105.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.225 H:M:S, 56.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/07-15:17:36 ... thread 0: (1000000,2000000) ops and (147070.6,124251.7) ops/second in (6.799457,16.096361) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.41 GB 50.4 0.6 0.0 0.6 2.5 1.8 0.0 1.3 35.9 143.5 17.56 8.07 24 0.732 639K 749 0.0 0.0 L1 3/3 178.85 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.0 1.5 112.2 112.1 7.03 3.55 3 2.343 800K 797 0.0 0.0 L2 2/0 69.60 MB 0.7 0.4 0.3 0.1 0.4 0.3 0.1 1.5 105.8 105.7 3.66 1.97 3 1.218 392K 305 0.0 0.0 L3 19/2 1.19 GB 1.0 5.9 4.2 1.7 5.9 4.2 0.1 1.4 108.0 107.1 56.38 28.39 27 2.088 2192K 588 0.0 0.0 L4 180/5 9.72 GB 1.0 8.3 5.4 2.9 8.2 5.3 0.4 1.5 117.8 116.4 72.25 39.74 54 1.338 5537K 7909 0.0 0.0 L5 1144/0 94.24 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1359/18 106.81 GB 0.0 16.0 10.4 5.7 17.7 12.1 6.2 9.6 104.5 115.7 156.87 81.72 111 1.413 9562K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.0 10.4 5.7 17.7 12.1 6.2 9.6 104.5 115.7 156.87 81.72 111 1.413 9562K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.0 10.4 5.7 15.9 10.2 0.0 0.0 115.0 114.0 142.59 76.27 89 1.602 9562K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 132.3 14.28 5.46 22 0.649 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.3 total, 16.1 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.72 GB write, 1113.77 MB/s write, 16.02 GB read, 1006.74 MB/s read, 156.9 seconds Interval compaction: 17.72 GB write, 1127.04 MB/s write, 16.02 GB read, 1018.74 MB/s read, 156.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 62, interval: 77 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 516629 Average: 9.8370 StdDev: 144.31 Min: 1 Median: 1.8002 Max: 21977 Percentiles: P50: 1.80 P75: 2.80 P99: 9.69 P99.9: 1885.33 P99.99: 4187.78 ------------------------------------------------------ [ 0, 1 ] 33186 6.424% 6.424% # ( 1, 2 ] 281356 54.460% 60.884% ########### ( 2, 3 ] 90860 17.587% 78.471% #### ( 3, 4 ] 49926 9.664% 88.134% ## ( 4, 6 ] 47656 9.224% 97.359% ## ( 6, 10 ] 9191 1.779% 99.138% ( 10, 15 ] 1755 0.340% 99.478% ( 15, 22 ] 192 0.037% 99.515% ( 22, 34 ] 17 0.003% 99.518% ( 34, 51 ] 15 0.003% 99.521% ( 51, 76 ] 10 0.002% 99.523% ( 76, 110 ] 4 0.001% 99.524% ( 110, 170 ] 23 0.004% 99.528% ( 170, 250 ] 76 0.015% 99.543% ( 250, 380 ] 141 0.027% 99.570% ( 380, 580 ] 338 0.065% 99.636% ( 580, 870 ] 519 0.100% 99.736% ( 870, 1300 ] 544 0.105% 99.841% ( 1300, 1900 ] 312 0.060% 99.902% ( 1900, 2900 ] 247 0.048% 99.949% ( 2900, 4400 ] 245 0.047% 99.997% ( 4400, 6600 ] 70 0.014% 100.010% ( 6600, 9900 ] 7 0.001% 100.012% ( 9900, 14000 ] 3 0.001% 100.012% ( 14000, 22000 ] 6 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 195148 Average: 10.3284 StdDev: 185.29 Min: 1 Median: 1.8974 Max: 31061 Percentiles: P50: 1.90 P75: 3.02 P99: 10.26 P99.9: 2064.90 P99.99: 5456.44 ------------------------------------------------------ [ 0, 1 ] 7367 3.775% 3.775% # ( 1, 2 ] 100518 51.509% 55.284% ########## ( 2, 3 ] 37996 19.470% 74.754% #### ( 3, 4 ] 20867 10.693% 85.447% ## ( 4, 6 ] 22048 11.298% 96.745% ## ( 6, 10 ] 4351 2.230% 98.975% ( 10, 15 ] 947 0.485% 99.460% ( 15, 22 ] 108 0.055% 99.515% ( 22, 34 ] 12 0.006% 99.521% ( 34, 51 ] 9 0.005% 99.526% ( 51, 76 ] 12 0.006% 99.532% ( 76, 110 ] 6 0.003% 99.535% ( 110, 170 ] 4 0.002% 99.537% ( 170, 250 ] 17 0.009% 99.546% ( 250, 380 ] 49 0.025% 99.571% ( 380, 580 ] 110 0.056% 99.627% ( 580, 870 ] 208 0.107% 99.734% ( 870, 1300 ] 191 0.098% 99.832% ( 1300, 1900 ] 119 0.061% 99.893% ( 1900, 2900 ] 84 0.043% 99.936% ( 2900, 4400 ] 93 0.048% 99.984% ( 4400, 6600 ] 26 0.013% 99.997% ( 6600, 9900 ] 4 0.002% 99.999% ( 14000, 22000 ] 2 0.001% 100.000% ( 22000, 33000 ] 4 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 997946 Average: 14.6010 StdDev: 204.14 Min: 1 Median: 1.9025 Max: 43531 Percentiles: P50: 1.90 P75: 3.00 P99: 12.69 P99.9: 1882.62 P99.99: 2862.66 ------------------------------------------------------ [ 0, 1 ] 40767 4.085% 4.085% # ( 1, 2 ] 507730 50.878% 54.963% ########## ( 2, 3 ] 200276 20.069% 75.031% #### ( 3, 4 ] 106333 10.655% 85.687% ## ( 4, 6 ] 104301 10.452% 96.138% ## ( 6, 10 ] 25061 2.511% 98.649% # ( 10, 15 ] 6492 0.651% 99.300% ( 15, 22 ] 827 0.083% 99.383% ( 22, 34 ] 111 0.011% 99.394% ( 34, 51 ] 76 0.008% 99.402% ( 51, 76 ] 91 0.009% 99.411% ( 76, 110 ] 37 0.004% 99.414% ( 110, 170 ] 98 0.010% 99.424% ( 170, 250 ] 187 0.019% 99.443% ( 250, 380 ] 416 0.042% 99.485% ( 380, 580 ] 792 0.079% 99.564% ( 580, 870 ] 1189 0.119% 99.683% ( 870, 1300 ] 1261 0.126% 99.810% ( 1300, 1900 ] 930 0.093% 99.903% ( 1900, 2900 ] 905 0.091% 99.993% ( 2900, 4400 ] 867 0.087% 100.080% ( 4400, 6600 ] 276 0.028% 100.108% ( 6600, 9900 ] 54 0.005% 100.113% ( 9900, 14000 ] 2 0.000% 100.114% ( 14000, 22000 ] 9 0.001% 100.114% ( 22000, 33000 ] 6 0.001% 100.115% ( 33000, 50000 ] 2 0.000% 100.115% ** Level 3 read latency histogram (micros): Count: 1811215 Average: 12.0265 StdDev: 182.38 Min: 1 Median: 1.9180 Max: 38333 Percentiles: P50: 1.92 P75: 3.01 P99: 10.01 P99.9: 1157.36 P99.99: 1859.19 ------------------------------------------------------ [ 0, 1 ] 52601 2.904% 2.904% # ( 1, 2 ] 929239 51.305% 54.209% ########## ( 2, 3 ] 375516 20.733% 74.942% #### ( 3, 4 ] 197368 10.897% 85.839% ## ( 4, 6 ] 196960 10.874% 96.713% ## ( 6, 10 ] 41409 2.286% 98.999% ( 10, 15 ] 9987 0.551% 99.551% ( 15, 22 ] 1077 0.059% 99.610% ( 22, 34 ] 106 0.006% 99.616% ( 34, 51 ] 150 0.008% 99.624% ( 51, 76 ] 191 0.011% 99.635% ( 76, 110 ] 55 0.003% 99.638% ( 110, 170 ] 98 0.005% 99.643% ( 170, 250 ] 214 0.012% 99.655% ( 250, 380 ] 442 0.024% 99.680% ( 380, 580 ] 1061 0.059% 99.738% ( 580, 870 ] 1776 0.098% 99.836% ( 870, 1300 ] 1728 0.095% 99.932% ( 1300, 1900 ] 1134 0.063% 99.994% ( 1900, 2900 ] 1267 0.070% 100.064% ( 2900, 4400 ] 1354 0.075% 100.139% ( 4400, 6600 ] 380 0.021% 100.160% ( 6600, 9900 ] 62 0.003% 100.163% ( 9900, 14000 ] 7 0.000% 100.164% ( 14000, 22000 ] 11 0.001% 100.164% ( 22000, 33000 ] 10 0.001% 100.165% ( 33000, 50000 ] 4 0.000% 100.165% ** Level 4 read latency histogram (micros): Count: 776646 Average: 24.2634 StdDev: 246.80 Min: 0 Median: 1.9096 Max: 31958 Percentiles: P50: 1.91 P75: 3.04 P99: 624.58 P99.9: 3077.77 P99.99: 3982.40 ------------------------------------------------------ [ 0, 1 ] 25931 3.339% 3.339% # ( 1, 2 ] 398415 51.299% 54.638% ########## ( 2, 3 ] 154585 19.904% 74.542% #### ( 3, 4 ] 83464 10.747% 85.289% ## ( 4, 6 ] 81383 10.479% 95.768% ## ( 6, 10 ] 17515 2.255% 98.023% ( 10, 15 ] 3954 0.509% 98.532% ( 15, 22 ] 427 0.055% 98.587% ( 22, 34 ] 44 0.006% 98.593% ( 34, 51 ] 72 0.009% 98.602% ( 51, 76 ] 103 0.013% 98.615% ( 76, 110 ] 45 0.006% 98.621% ( 110, 170 ] 114 0.015% 98.636% ( 170, 250 ] 308 0.040% 98.676% ( 250, 380 ] 708 0.091% 98.767% ( 380, 580 ] 1458 0.188% 98.954% ( 580, 870 ] 2300 0.296% 99.251% ( 870, 1300 ] 2327 0.300% 99.550% ( 1300, 1900 ] 1426 0.184% 99.734% ( 1900, 2900 ] 1153 0.148% 99.882% ( 2900, 4400 ] 1159 0.149% 100.032% ( 4400, 6600 ] 338 0.044% 100.075% ( 6600, 9900 ] 48 0.006% 100.081% ( 9900, 14000 ] 3 0.000% 100.082% ( 14000, 22000 ] 7 0.001% 100.083% ( 22000, 33000 ] 7 0.001% 100.083% ** Level 5 read latency histogram (micros): Count: 31359 Average: 1531.3859 StdDev: 1517.93 Min: 85 Median: 1043.0675 Max: 43939 Percentiles: P50: 1043.07 P75: 1987.47 P99: 6391.77 P99.9: 12388.02 P99.99: 38281.62 ------------------------------------------------------ ( 76, 110 ] 37 0.118% 0.118% ( 110, 170 ] 269 0.858% 0.976% ( 170, 250 ] 721 2.299% 3.275% ( 250, 380 ] 1930 6.155% 9.430% # ( 380, 580 ] 4018 12.813% 22.242% ### ( 580, 870 ] 6224 19.848% 42.090% #### ( 870, 1300 ] 6163 19.653% 61.743% #### ( 1300, 1900 ] 3872 12.347% 74.090% ## ( 1900, 2900 ] 3261 10.399% 84.489% ## ( 2900, 4400 ] 3483 11.107% 95.596% ## ( 4400, 6600 ] 1179 3.760% 99.356% # ( 6600, 9900 ] 167 0.533% 99.888% ( 9900, 14000 ] 6 0.019% 99.908% ( 14000, 22000 ] 14 0.045% 99.952% ( 22000, 33000 ] 10 0.032% 99.984% ( 33000, 50000 ] 6 0.019% 100.003% ** DB Stats ** Uptime(secs): 16.3 total, 6.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 120.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.046 H:M:S, 49.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 144.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.821 H:M:S, 41.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/07-15:17:39 ... thread 0: (1000000,3000000) ops and (288801.5,153382.5) ops/second in (3.462586,19.558947) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 1.78 GB 69.2 1.4 0.0 1.4 4.2 2.8 0.0 1.5 60.3 180.9 24.01 13.98 43 0.558 1471K 1571 0.0 0.0 L1 10/10 805.73 MB 0.0 1.6 1.1 0.4 1.6 1.1 0.0 1.4 129.0 128.8 12.38 7.22 4 3.094 1621K 3285 0.0 0.0 L2 2/0 69.60 MB 0.7 0.4 0.3 0.1 0.4 0.3 0.1 1.5 105.8 105.7 3.66 1.97 3 1.218 392K 305 0.0 0.0 L3 17/0 973.76 MB 1.0 5.9 4.2 1.7 5.9 4.2 0.1 1.4 108.0 107.1 56.38 28.39 27 2.088 2192K 588 0.0 0.0 L4 178/0 9.65 GB 1.0 8.7 5.6 3.1 8.6 5.5 0.4 1.5 118.9 117.5 74.91 41.52 56 1.338 5869K 8062 0.0 0.0 L5 1148/0 94.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1369/19 107.79 GB 0.0 18.0 11.2 6.8 20.7 13.9 6.5 7.3 107.5 123.6 171.34 93.08 133 1.288 11M 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.0 11.2 6.8 20.7 13.9 6.5 7.3 107.5 123.6 171.34 93.08 133 1.288 11M 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.0 11.2 6.8 17.8 11.1 0.0 0.0 119.8 118.7 153.87 84.84 95 1.620 11M 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 165.9 17.47 8.24 38 0.460 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.8 total, 19.6 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.67 GB write, 1071.73 MB/s write, 17.99 GB read, 932.88 MB/s read, 171.3 seconds Interval compaction: 20.67 GB write, 1082.24 MB/s write, 17.99 GB read, 942.03 MB/s read, 171.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 62, interval: 77 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 812827 Average: 7.7747 StdDev: 116.62 Min: 1 Median: 1.6609 Max: 21977 Percentiles: P50: 1.66 P75: 2.38 P99: 9.61 P99.9: 1226.71 P99.99: 3303.53 ------------------------------------------------------ [ 0, 1 ] 97344 11.976% 11.976% ## ( 1, 2 ] 467637 57.532% 69.508% ############ ( 2, 3 ] 117363 14.439% 83.947% ### ( 3, 4 ] 59429 7.311% 91.258% # ( 4, 6 ] 53106 6.533% 97.792% # ( 6, 10 ] 10871 1.337% 99.129% ( 10, 15 ] 2060 0.253% 99.383% ( 15, 22 ] 235 0.029% 99.412% ( 22, 34 ] 18 0.002% 99.414% ( 34, 51 ] 18 0.002% 99.416% ( 51, 76 ] 11 0.001% 99.417% ( 76, 110 ] 198 0.024% 99.442% ( 110, 170 ] 857 0.105% 99.547% ( 170, 250 ] 636 0.078% 99.626% ( 250, 380 ] 472 0.058% 99.684% ( 380, 580 ] 627 0.077% 99.761% ( 580, 870 ] 657 0.081% 99.842% ( 870, 1300 ] 574 0.071% 99.912% ( 1300, 1900 ] 317 0.039% 99.951% ( 1900, 2900 ] 250 0.031% 99.982% ( 2900, 4400 ] 248 0.031% 100.012% ( 4400, 6600 ] 70 0.009% 100.021% ( 6600, 9900 ] 7 0.001% 100.022% ( 9900, 14000 ] 3 0.000% 100.022% ( 14000, 22000 ] 6 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 274074 Average: 8.8026 StdDev: 157.51 Min: 1 Median: 1.7772 Max: 31061 Percentiles: P50: 1.78 P75: 2.74 P99: 11.70 P99.9: 1589.96 P99.99: 4703.99 ------------------------------------------------------ [ 0, 1 ] 18637 6.800% 6.800% # ( 1, 2 ] 152347 55.586% 62.386% ########### ( 2, 3 ] 46583 16.997% 79.383% ### ( 3, 4 ] 23817 8.690% 88.073% ## ( 4, 6 ] 23885 8.715% 96.787% ## ( 6, 10 ] 5687 2.075% 98.862% ( 10, 15 ] 1112 0.406% 99.268% ( 15, 22 ] 131 0.048% 99.316% ( 22, 34 ] 15 0.005% 99.321% ( 34, 51 ] 9 0.003% 99.325% ( 51, 76 ] 13 0.005% 99.329% ( 76, 110 ] 126 0.046% 99.375% ( 110, 170 ] 360 0.131% 99.507% ( 170, 250 ] 224 0.082% 99.588% ( 250, 380 ] 163 0.059% 99.648% ( 380, 580 ] 187 0.068% 99.716% ( 580, 870 ] 243 0.089% 99.805% ( 870, 1300 ] 201 0.073% 99.878% ( 1300, 1900 ] 124 0.045% 99.923% ( 1900, 2900 ] 85 0.031% 99.954% ( 2900, 4400 ] 94 0.034% 99.989% ( 4400, 6600 ] 26 0.009% 99.998% ( 6600, 9900 ] 4 0.001% 100.000% ( 14000, 22000 ] 2 0.001% 100.000% ( 22000, 33000 ] 4 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 998048 Average: 14.6240 StdDev: 204.15 Min: 1 Median: 1.9026 Max: 43531 Percentiles: P50: 1.90 P75: 3.00 P99: 12.77 P99.9: 1882.55 P99.99: 2862.65 ------------------------------------------------------ [ 0, 1 ] 40767 4.085% 4.085% # ( 1, 2 ] 507730 50.872% 54.957% ########## ( 2, 3 ] 200276 20.067% 75.024% #### ( 3, 4 ] 106333 10.654% 85.678% ## ( 4, 6 ] 104301 10.450% 96.128% ## ( 6, 10 ] 25061 2.511% 98.639% # ( 10, 15 ] 6492 0.650% 99.290% ( 15, 22 ] 827 0.083% 99.373% ( 22, 34 ] 111 0.011% 99.384% ( 34, 51 ] 76 0.008% 99.391% ( 51, 76 ] 91 0.009% 99.401% ( 76, 110 ] 49 0.005% 99.405% ( 110, 170 ] 138 0.014% 99.419% ( 170, 250 ] 207 0.021% 99.440% ( 250, 380 ] 429 0.043% 99.483% ( 380, 580 ] 803 0.080% 99.563% ( 580, 870 ] 1195 0.120% 99.683% ( 870, 1300 ] 1261 0.126% 99.810% ( 1300, 1900 ] 930 0.093% 99.903% ( 1900, 2900 ] 905 0.091% 99.993% ( 2900, 4400 ] 867 0.087% 100.080% ( 4400, 6600 ] 276 0.028% 100.108% ( 6600, 9900 ] 54 0.005% 100.113% ( 9900, 14000 ] 2 0.000% 100.114% ( 14000, 22000 ] 9 0.001% 100.114% ( 22000, 33000 ] 6 0.001% 100.115% ( 33000, 50000 ] 2 0.000% 100.115% ** Level 3 read latency histogram (micros): Count: 1825278 Average: 12.0765 StdDev: 181.80 Min: 1 Median: 1.9169 Max: 38333 Percentiles: P50: 1.92 P75: 3.00 P99: 10.45 P99.9: 1153.96 P99.99: 1855.39 ------------------------------------------------------ [ 0, 1 ] 53029 2.905% 2.905% # ( 1, 2 ] 937531 51.364% 54.269% ########## ( 2, 3 ] 377949 20.706% 74.975% #### ( 3, 4 ] 198271 10.863% 85.838% ## ( 4, 6 ] 197687 10.831% 96.668% ## ( 6, 10 ] 41662 2.283% 98.951% ( 10, 15 ] 10034 0.550% 99.501% ( 15, 22 ] 1085 0.059% 99.560% ( 22, 34 ] 107 0.006% 99.566% ( 34, 51 ] 150 0.008% 99.574% ( 51, 76 ] 191 0.010% 99.585% ( 76, 110 ] 167 0.009% 99.594% ( 110, 170 ] 505 0.028% 99.621% ( 170, 250 ] 431 0.024% 99.645% ( 250, 380 ] 543 0.030% 99.675% ( 380, 580 ] 1149 0.063% 99.738% ( 580, 870 ] 1814 0.099% 99.837% ( 870, 1300 ] 1738 0.095% 99.932% ( 1300, 1900 ] 1137 0.062% 99.995% ( 1900, 2900 ] 1267 0.069% 100.064% ( 2900, 4400 ] 1354 0.074% 100.138% ( 4400, 6600 ] 380 0.021% 100.159% ( 6600, 9900 ] 62 0.003% 100.162% ( 9900, 14000 ] 7 0.000% 100.163% ( 14000, 22000 ] 11 0.001% 100.163% ( 22000, 33000 ] 10 0.001% 100.164% ( 33000, 50000 ] 4 0.000% 100.164% ** Level 4 read latency histogram (micros): Count: 794667 Average: 25.7702 StdDev: 245.33 Min: 0 Median: 1.9133 Max: 31958 Percentiles: P50: 1.91 P75: 3.09 P99: 635.76 P99.9: 3056.76 P99.99: 3980.79 ------------------------------------------------------ [ 0, 1 ] 27477 3.458% 3.458% # ( 1, 2 ] 404947 50.958% 54.416% ########## ( 2, 3 ] 156211 19.657% 74.073% #### ( 3, 4 ] 84020 10.573% 84.646% ## ( 4, 6 ] 81916 10.308% 94.954% ## ( 6, 10 ] 17647 2.221% 97.175% ( 10, 15 ] 3987 0.502% 97.677% ( 15, 22 ] 432 0.054% 97.731% ( 22, 34 ] 45 0.006% 97.737% ( 34, 51 ] 72 0.009% 97.746% ( 51, 76 ] 103 0.013% 97.759% ( 76, 110 ] 952 0.120% 97.879% ( 110, 170 ] 3035 0.382% 98.261% ( 170, 250 ] 1746 0.220% 98.480% ( 250, 380 ] 1477 0.186% 98.666% ( 380, 580 ] 2163 0.272% 98.938% ( 580, 870 ] 2550 0.321% 99.259% ( 870, 1300 ] 2384 0.300% 99.559% ( 1300, 1900 ] 1431 0.180% 99.739% ( 1900, 2900 ] 1156 0.145% 99.885% ( 2900, 4400 ] 1161 0.146% 100.031% ( 4400, 6600 ] 338 0.043% 100.073% ( 6600, 9900 ] 48 0.006% 100.079% ( 9900, 14000 ] 3 0.000% 100.080% ( 14000, 22000 ] 7 0.001% 100.081% ( 22000, 33000 ] 7 0.001% 100.082% ** Level 5 read latency histogram (micros): Count: 72547 Average: 790.6369 StdDev: 1196.51 Min: 73 Median: 335.9169 Max: 43939 Percentiles: P50: 335.92 P75: 897.43 P99: 5613.88 P99.9: 9059.25 P99.99: 25019.83 ------------------------------------------------------ ( 51, 76 ] 8 0.011% 0.011% ( 76, 110 ] 5435 7.492% 7.503% # ( 110, 170 ] 17178 23.678% 31.181% ##### ( 170, 250 ] 9317 12.843% 44.024% ### ( 250, 380 ] 6560 9.042% 53.066% ## ( 380, 580 ] 7799 10.750% 63.817% ## ( 580, 870 ] 7700 10.614% 74.430% ## ( 870, 1300 ] 6478 8.929% 83.360% ## ( 1300, 1900 ] 3918 5.401% 88.760% # ( 1900, 2900 ] 3285 4.528% 93.288% # ( 2900, 4400 ] 3493 4.815% 98.103% # ( 4400, 6600 ] 1179 1.625% 99.728% ( 6600, 9900 ] 167 0.230% 99.959% ( 9900, 14000 ] 6 0.008% 99.967% ( 14000, 22000 ] 14 0.019% 99.986% ( 22000, 33000 ] 10 0.014% 100.000% ( 33000, 50000 ] 6 0.008% 100.008% ** DB Stats ** Uptime(secs): 19.8 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 149.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.046 H:M:S, 40.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/12/07-15:17:43 ... thread 0: (1000000,4000000) ops and (287709.7,173651.3) ops/second in (3.475726,23.034673) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 2.70 GB 163.6 2.4 0.0 2.4 6.1 3.8 0.0 1.6 79.5 203.8 30.90 20.38 62 0.498 2494K 2538 0.0 0.0 L1 10/10 805.73 MB 0.0 1.6 1.1 0.4 1.6 1.1 0.0 1.4 129.0 128.8 12.38 7.22 4 3.094 1621K 3285 0.0 0.0 L2 2/0 69.60 MB 0.7 0.4 0.3 0.1 0.4 0.3 0.1 1.5 105.8 105.7 3.66 1.97 3 1.218 392K 305 0.0 0.0 L3 17/0 973.76 MB 1.0 5.9 4.2 1.7 5.9 4.2 0.1 1.4 108.0 107.1 56.38 28.39 27 2.088 2192K 588 0.0 0.0 L4 178/0 9.65 GB 1.0 8.7 5.6 3.1 8.6 5.5 0.4 1.5 118.9 117.5 74.91 41.52 56 1.338 5869K 8062 0.0 0.0 L5 1148/0 94.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1372/19 108.71 GB 0.0 19.0 11.2 7.8 22.6 14.8 6.5 6.0 109.0 129.7 178.22 99.47 152 1.173 12M 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.0 11.2 7.8 22.6 14.8 6.5 6.0 109.0 129.7 178.22 99.47 152 1.173 12M 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.0 11.2 7.8 18.8 11.1 0.0 0.0 123.2 122.2 157.79 88.66 99 1.594 12M 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 188.0 20.44 10.81 53 0.386 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.2 total, 23.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.58 GB write, 995.39 MB/s write, 18.98 GB read, 836.68 MB/s read, 178.2 seconds Interval compaction: 22.58 GB write, 1003.68 MB/s write, 18.98 GB read, 843.65 MB/s read, 178.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 62, interval: 77 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1155545 Average: 7.1060 StdDev: 99.75 Min: 1 Median: 1.5990 Max: 21977 Percentiles: P50: 1.60 P75: 2.11 P99: 11.98 P99.9: 861.52 P99.99: 2194.71 ------------------------------------------------------ [ 0, 1 ] 171076 14.805% 14.805% ### ( 1, 2 ] 678979 58.758% 73.563% ############ ( 2, 3 ] 149405 12.929% 86.493% ### ( 3, 4 ] 71164 6.158% 92.651% # ( 4, 6 ] 59644 5.162% 97.813% # ( 6, 10 ] 12755 1.104% 98.916% ( 10, 15 ] 2441 0.211% 99.128% ( 15, 22 ] 319 0.028% 99.155% ( 22, 34 ] 30 0.003% 99.158% ( 34, 51 ] 20 0.002% 99.160% ( 51, 76 ] 16 0.001% 99.161% ( 76, 110 ] 719 0.062% 99.223% ( 110, 170 ] 2977 0.258% 99.481% ( 170, 250 ] 1821 0.158% 99.638% ( 250, 380 ] 1093 0.095% 99.733% ( 380, 580 ] 1150 0.100% 99.832% ( 580, 870 ] 805 0.070% 99.902% ( 870, 1300 ] 614 0.053% 99.955% ( 1300, 1900 ] 327 0.028% 99.984% ( 1900, 2900 ] 256 0.022% 100.006% ( 2900, 4400 ] 249 0.022% 100.027% ( 4400, 6600 ] 70 0.006% 100.033% ( 6600, 9900 ] 7 0.001% 100.034% ( 9900, 14000 ] 3 0.000% 100.034% ( 14000, 22000 ] 6 0.001% 100.035% ** Level 1 read latency histogram (micros): Count: 357083 Average: 7.9404 StdDev: 138.70 Min: 1 Median: 1.7439 Max: 31061 Percentiles: P50: 1.74 P75: 2.63 P99: 13.46 P99.9: 1249.48 P99.99: 4277.00 ------------------------------------------------------ [ 0, 1 ] 26447 7.406% 7.406% # ( 1, 2 ] 204457 57.258% 64.664% ########### ( 2, 3 ] 59008 16.525% 81.189% ### ( 3, 4 ] 28385 7.949% 89.138% ## ( 4, 6 ] 27009 7.564% 96.702% ## ( 6, 10 ] 7252 2.031% 98.733% ( 10, 15 ] 1379 0.386% 99.119% ( 15, 22 ] 205 0.057% 99.176% ( 22, 34 ] 24 0.007% 99.183% ( 34, 51 ] 9 0.003% 99.186% ( 51, 76 ] 13 0.004% 99.189% ( 76, 110 ] 278 0.078% 99.267% ( 110, 170 ] 838 0.235% 99.502% ( 170, 250 ] 434 0.122% 99.623% ( 250, 380 ] 263 0.074% 99.697% ( 380, 580 ] 275 0.077% 99.774% ( 580, 870 ] 269 0.075% 99.849% ( 870, 1300 ] 205 0.057% 99.907% ( 1300, 1900 ] 126 0.035% 99.942% ( 1900, 2900 ] 85 0.024% 99.966% ( 2900, 4400 ] 94 0.026% 99.992% ( 4400, 6600 ] 26 0.007% 99.999% ( 6600, 9900 ] 4 0.001% 100.001% ( 14000, 22000 ] 2 0.001% 100.001% ( 22000, 33000 ] 4 0.001% 100.002% ** Level 2 read latency histogram (micros): Count: 998137 Average: 14.6403 StdDev: 204.15 Min: 1 Median: 1.9026 Max: 43531 Percentiles: P50: 1.90 P75: 3.00 P99: 12.84 P99.9: 1882.49 P99.99: 2862.64 ------------------------------------------------------ [ 0, 1 ] 40767 4.084% 4.084% # ( 1, 2 ] 507730 50.868% 54.952% ########## ( 2, 3 ] 200276 20.065% 75.017% #### ( 3, 4 ] 106333 10.653% 85.670% ## ( 4, 6 ] 104301 10.450% 96.120% ## ( 6, 10 ] 25061 2.511% 98.631% # ( 10, 15 ] 6492 0.650% 99.281% ( 15, 22 ] 827 0.083% 99.364% ( 22, 34 ] 111 0.011% 99.375% ( 34, 51 ] 76 0.008% 99.383% ( 51, 76 ] 91 0.009% 99.392% ( 76, 110 ] 66 0.007% 99.398% ( 110, 170 ] 172 0.017% 99.416% ( 170, 250 ] 226 0.023% 99.438% ( 250, 380 ] 441 0.044% 99.482% ( 380, 580 ] 808 0.081% 99.563% ( 580, 870 ] 1197 0.120% 99.683% ( 870, 1300 ] 1261 0.126% 99.810% ( 1300, 1900 ] 930 0.093% 99.903% ( 1900, 2900 ] 905 0.091% 99.993% ( 2900, 4400 ] 867 0.087% 100.080% ( 4400, 6600 ] 276 0.028% 100.108% ( 6600, 9900 ] 54 0.005% 100.113% ( 9900, 14000 ] 2 0.000% 100.114% ( 14000, 22000 ] 9 0.001% 100.114% ( 22000, 33000 ] 6 0.001% 100.115% ( 33000, 50000 ] 2 0.000% 100.115% ** Level 3 read latency histogram (micros): Count: 1826090 Average: 12.1714 StdDev: 181.84 Min: 1 Median: 1.9173 Max: 38333 Percentiles: P50: 1.92 P75: 3.01 P99: 10.85 P99.9: 1154.01 P99.99: 1855.35 ------------------------------------------------------ [ 0, 1 ] 53029 2.904% 2.904% # ( 1, 2 ] 937531 51.341% 54.245% ########## ( 2, 3 ] 377949 20.697% 74.942% #### ( 3, 4 ] 198271 10.858% 85.800% ## ( 4, 6 ] 197687 10.826% 96.625% ## ( 6, 10 ] 41662 2.281% 98.907% ( 10, 15 ] 10034 0.549% 99.456% ( 15, 22 ] 1085 0.059% 99.516% ( 22, 34 ] 107 0.006% 99.522% ( 34, 51 ] 150 0.008% 99.530% ( 51, 76 ] 191 0.010% 99.540% ( 76, 110 ] 277 0.015% 99.555% ( 110, 170 ] 830 0.045% 99.601% ( 170, 250 ] 594 0.033% 99.633% ( 250, 380 ] 632 0.035% 99.668% ( 380, 580 ] 1237 0.068% 99.736% ( 580, 870 ] 1848 0.101% 99.837% ( 870, 1300 ] 1741 0.095% 99.932% ( 1300, 1900 ] 1137 0.062% 99.995% ( 1900, 2900 ] 1267 0.069% 100.064% ( 2900, 4400 ] 1354 0.074% 100.138% ( 4400, 6600 ] 380 0.021% 100.159% ( 6600, 9900 ] 62 0.003% 100.162% ( 9900, 14000 ] 7 0.000% 100.163% ( 14000, 22000 ] 11 0.001% 100.163% ( 22000, 33000 ] 10 0.001% 100.164% ( 33000, 50000 ] 4 0.000% 100.164% ** Level 4 read latency histogram (micros): Count: 802503 Average: 27.6100 StdDev: 245.45 Min: 0 Median: 1.9230 Max: 31958 Percentiles: P50: 1.92 P75: 3.16 P99: 654.28 P99.9: 3048.96 P99.99: 3980.50 ------------------------------------------------------ [ 0, 1 ] 27477 3.424% 3.424% # ( 1, 2 ] 404975 50.464% 53.888% ########## ( 2, 3 ] 156333 19.481% 73.369% #### ( 3, 4 ] 84070 10.476% 83.845% ## ( 4, 6 ] 82004 10.219% 94.063% ## ( 6, 10 ] 17665 2.201% 96.264% ( 10, 15 ] 3988 0.497% 96.761% ( 15, 22 ] 432 0.054% 96.815% ( 22, 34 ] 45 0.006% 96.821% ( 34, 51 ] 72 0.009% 96.830% ( 51, 76 ] 103 0.013% 96.843% ( 76, 110 ] 1890 0.236% 97.078% ( 110, 170 ] 6152 0.767% 97.845% ( 170, 250 ] 3424 0.427% 98.271% ( 250, 380 ] 2309 0.288% 98.559% ( 380, 580 ] 2822 0.352% 98.911% ( 580, 870 ] 2799 0.349% 99.259% ( 870, 1300 ] 2425 0.302% 99.562% ( 1300, 1900 ] 1439 0.179% 99.741% ( 1900, 2900 ] 1161 0.145% 99.886% ( 2900, 4400 ] 1163 0.145% 100.031% ( 4400, 6600 ] 338 0.042% 100.073% ( 6600, 9900 ] 48 0.006% 100.079% ( 9900, 14000 ] 3 0.000% 100.079% ( 14000, 22000 ] 7 0.001% 100.080% ( 22000, 33000 ] 7 0.001% 100.081% ** Level 5 read latency histogram (micros): Count: 112467 Average: 589.1792 StdDev: 1003.83 Min: 73 Median: 223.2943 Max: 43939 Percentiles: P50: 223.29 P75: 575.27 P99: 4859.65 P99.9: 8171.61 P99.99: 18430.46 ------------------------------------------------------ ( 51, 76 ] 10 0.009% 0.009% ( 76, 110 ] 10336 9.190% 9.199% ## ( 110, 170 ] 33821 30.072% 39.271% ###### ( 170, 250 ] 18113 16.105% 55.376% ### ( 250, 380 ] 11007 9.787% 65.163% ## ( 380, 580 ] 11331 10.075% 75.238% ## ( 580, 870 ] 8955 7.962% 83.200% ## ( 870, 1300 ] 6764 6.014% 89.215% # ( 1300, 1900 ] 3950 3.512% 92.727% # ( 1900, 2900 ] 3306 2.940% 95.666% # ( 2900, 4400 ] 3503 3.115% 98.781% # ( 4400, 6600 ] 1179 1.048% 99.829% ( 6600, 9900 ] 167 0.148% 99.978% ( 9900, 14000 ] 6 0.005% 99.983% ( 14000, 22000 ] 14 0.012% 99.996% ( 22000, 33000 ] 10 0.009% 100.004% ( 33000, 50000 ] 6 0.005% 100.010% ** DB Stats ** Uptime(secs): 23.2 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 169.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.046 H:M:S, 34.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/07-15:17:48 ... thread 0: (1000000,5000000) ops and (200771.9,178472.9) ops/second in (4.980777,28.015450) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/5 3.69 GB 289.5 3.6 0.0 3.6 8.4 4.7 0.0 1.8 95.5 220.1 38.90 27.88 83 0.469 3773K 3788 0.0 0.0 L1 10/10 805.73 MB 0.0 1.6 1.1 0.4 1.6 1.1 0.0 1.4 129.0 128.8 12.38 7.22 4 3.094 1621K 3285 0.0 0.0 L2 2/0 69.60 MB 0.7 0.4 0.3 0.1 0.4 0.3 0.1 1.5 105.8 105.7 3.66 1.97 3 1.218 392K 305 0.0 0.0 L3 17/0 973.76 MB 1.0 5.9 4.2 1.7 5.9 4.2 0.1 1.4 108.0 107.1 56.38 28.39 27 2.088 2192K 588 0.0 0.0 L4 178/0 9.65 GB 1.0 8.7 5.6 3.1 8.6 5.5 0.4 1.5 118.9 117.5 74.91 41.52 56 1.338 5869K 8062 0.0 0.0 L5 1148/0 94.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1373/15 109.69 GB 0.0 20.2 11.2 9.0 24.8 15.8 6.5 5.2 111.1 136.3 186.22 106.97 173 1.076 13M 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.2 11.2 9.0 24.8 15.8 6.5 5.2 111.1 136.3 186.22 106.97 173 1.076 13M 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.2 11.2 9.0 20.1 11.1 0.0 0.0 127.3 126.3 162.59 93.37 104 1.563 13M 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 205.2 23.63 13.60 69 0.343 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.2 total, 28.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.79 GB write, 899.99 MB/s write, 20.21 GB read, 733.62 MB/s read, 186.2 seconds Interval compaction: 24.79 GB write, 906.16 MB/s write, 20.21 GB read, 738.64 MB/s read, 186.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 15, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 62, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1477813 Average: 9.3131 StdDev: 93.29 Min: 0 Median: 1.5660 Max: 21977 Percentiles: P50: 1.57 P75: 2.01 P99: 170.37 P99.9: 770.79 P99.99: 1729.22 ------------------------------------------------------ [ 0, 1 ] 259794 17.580% 17.580% #### ( 1, 2 ] 846514 57.282% 74.861% ########### ( 2, 3 ] 171723 11.620% 86.481% ## ( 3, 4 ] 80490 5.447% 91.928% # ( 4, 6 ] 65948 4.463% 96.390% # ( 6, 10 ] 13952 0.944% 97.334% ( 10, 15 ] 2757 0.187% 97.521% ( 15, 22 ] 382 0.026% 97.547% ( 22, 34 ] 40 0.003% 97.550% ( 34, 51 ] 24 0.002% 97.551% ( 51, 76 ] 23 0.002% 97.553% ( 76, 110 ] 4441 0.301% 97.853% ( 110, 170 ] 16915 1.145% 98.998% ( 170, 250 ] 7019 0.475% 99.473% ( 250, 380 ] 2985 0.202% 99.675% ( 380, 580 ] 2518 0.170% 99.845% ( 580, 870 ] 1233 0.083% 99.929% ( 870, 1300 ] 670 0.045% 99.974% ( 1300, 1900 ] 333 0.023% 99.996% ( 1900, 2900 ] 271 0.018% 100.015% ( 2900, 4400 ] 256 0.017% 100.032% ( 4400, 6600 ] 70 0.005% 100.037% ( 6600, 9900 ] 7 0.000% 100.037% ( 9900, 14000 ] 3 0.000% 100.038% ( 14000, 22000 ] 6 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 389575 Average: 8.3105 StdDev: 133.46 Min: 1 Median: 1.8018 Max: 31061 Percentiles: P50: 1.80 P75: 2.84 P99: 111.04 P99.9: 1182.48 P99.99: 4193.23 ------------------------------------------------------ [ 0, 1 ] 26652 6.841% 6.841% # ( 1, 2 ] 209691 53.826% 60.667% ########### ( 2, 3 ] 66651 17.109% 77.776% ### ( 3, 4 ] 34839 8.943% 86.718% ## ( 4, 6 ] 35778 9.184% 95.902% ## ( 6, 10 ] 9170 2.354% 98.256% ( 10, 15 ] 1796 0.461% 98.717% ( 15, 22 ] 494 0.127% 98.844% ( 22, 34 ] 56 0.014% 98.858% ( 34, 51 ] 10 0.003% 98.861% ( 51, 76 ] 13 0.003% 98.864% ( 76, 110 ] 500 0.128% 98.992% ( 110, 170 ] 1691 0.434% 99.427% ( 170, 250 ] 712 0.183% 99.609% ( 250, 380 ] 364 0.093% 99.703% ( 380, 580 ] 333 0.085% 99.788% ( 580, 870 ] 285 0.073% 99.861% ( 870, 1300 ] 207 0.053% 99.915% ( 1300, 1900 ] 126 0.032% 99.947% ( 1900, 2900 ] 87 0.022% 99.969% ( 2900, 4400 ] 94 0.024% 99.993% ( 4400, 6600 ] 26 0.007% 100.000% ( 6600, 9900 ] 4 0.001% 100.001% ( 14000, 22000 ] 2 0.001% 100.002% ( 22000, 33000 ] 4 0.001% 100.003% ** Level 2 read latency histogram (micros): Count: 998328 Average: 14.6702 StdDev: 204.15 Min: 1 Median: 1.9028 Max: 43531 Percentiles: P50: 1.90 P75: 3.00 P99: 12.99 P99.9: 1882.37 P99.99: 2862.62 ------------------------------------------------------ [ 0, 1 ] 40767 4.084% 4.084% # ( 1, 2 ] 507730 50.858% 54.942% ########## ( 2, 3 ] 200276 20.061% 75.003% #### ( 3, 4 ] 106333 10.651% 85.654% ## ( 4, 6 ] 104301 10.448% 96.101% ## ( 6, 10 ] 25061 2.510% 98.612% # ( 10, 15 ] 6492 0.650% 99.262% ( 15, 22 ] 827 0.083% 99.345% ( 22, 34 ] 111 0.011% 99.356% ( 34, 51 ] 76 0.008% 99.364% ( 51, 76 ] 91 0.009% 99.373% ( 76, 110 ] 101 0.010% 99.383% ( 110, 170 ] 268 0.027% 99.410% ( 170, 250 ] 266 0.027% 99.436% ( 250, 380 ] 450 0.045% 99.481% ( 380, 580 ] 817 0.082% 99.563% ( 580, 870 ] 1199 0.120% 99.683% ( 870, 1300 ] 1261 0.126% 99.810% ( 1300, 1900 ] 930 0.093% 99.903% ( 1900, 2900 ] 905 0.091% 99.993% ( 2900, 4400 ] 867 0.087% 100.080% ( 4400, 6600 ] 276 0.028% 100.108% ( 6600, 9900 ] 54 0.005% 100.113% ( 9900, 14000 ] 2 0.000% 100.113% ( 14000, 22000 ] 9 0.001% 100.114% ( 22000, 33000 ] 6 0.001% 100.115% ( 33000, 50000 ] 2 0.000% 100.115% ** Level 3 read latency histogram (micros): Count: 1827527 Average: 12.3045 StdDev: 181.87 Min: 1 Median: 1.9181 Max: 38333 Percentiles: P50: 1.92 P75: 3.01 P99: 11.56 P99.9: 1154.48 P99.99: 1855.35 ------------------------------------------------------ [ 0, 1 ] 53029 2.902% 2.902% # ( 1, 2 ] 937531 51.301% 54.202% ########## ( 2, 3 ] 377949 20.681% 74.883% #### ( 3, 4 ] 198271 10.849% 85.732% ## ( 4, 6 ] 197687 10.817% 96.549% ## ( 6, 10 ] 41662 2.280% 98.829% ( 10, 15 ] 10034 0.549% 99.378% ( 15, 22 ] 1085 0.059% 99.438% ( 22, 34 ] 107 0.006% 99.443% ( 34, 51 ] 150 0.008% 99.452% ( 51, 76 ] 191 0.010% 99.462% ( 76, 110 ] 505 0.028% 99.490% ( 110, 170 ] 1582 0.087% 99.576% ( 170, 250 ] 879 0.048% 99.624% ( 250, 380 ] 714 0.039% 99.663% ( 380, 580 ] 1301 0.071% 99.735% ( 580, 870 ] 1868 0.102% 99.837% ( 870, 1300 ] 1745 0.095% 99.932% ( 1300, 1900 ] 1139 0.062% 99.995% ( 1900, 2900 ] 1267 0.069% 100.064% ( 2900, 4400 ] 1354 0.074% 100.138% ( 4400, 6600 ] 380 0.021% 100.159% ( 6600, 9900 ] 62 0.003% 100.162% ( 9900, 14000 ] 7 0.000% 100.163% ( 14000, 22000 ] 11 0.001% 100.163% ( 22000, 33000 ] 10 0.001% 100.164% ( 33000, 50000 ] 4 0.000% 100.164% ** Level 4 read latency histogram (micros): Count: 815063 Average: 29.9641 StdDev: 244.74 Min: 0 Median: 1.9385 Max: 31958 Percentiles: P50: 1.94 P75: 3.27 P99: 658.46 P99.9: 3032.76 P99.99: 3978.88 ------------------------------------------------------ [ 0, 1 ] 27477 3.371% 3.371% # ( 1, 2 ] 404975 49.686% 53.057% ########## ( 2, 3 ] 156333 19.180% 72.238% #### ( 3, 4 ] 84070 10.315% 82.553% ## ( 4, 6 ] 82004 10.061% 92.614% ## ( 6, 10 ] 17665 2.167% 94.781% ( 10, 15 ] 3988 0.489% 95.270% ( 15, 22 ] 432 0.053% 95.323% ( 22, 34 ] 45 0.006% 95.329% ( 34, 51 ] 72 0.009% 95.338% ( 51, 76 ] 104 0.013% 95.350% ( 76, 110 ] 3901 0.479% 95.829% ( 110, 170 ] 12840 1.575% 97.404% ( 170, 250 ] 5654 0.694% 98.098% ( 250, 380 ] 3120 0.383% 98.481% ( 380, 580 ] 3426 0.420% 98.901% ( 580, 870 ] 2984 0.366% 99.267% ( 870, 1300 ] 2448 0.300% 99.568% ( 1300, 1900 ] 1443 0.177% 99.745% ( 1900, 2900 ] 1165 0.143% 99.887% ( 2900, 4400 ] 1163 0.143% 100.030% ( 4400, 6600 ] 338 0.041% 100.072% ( 6600, 9900 ] 48 0.006% 100.078% ( 9900, 14000 ] 3 0.000% 100.078% ( 14000, 22000 ] 7 0.001% 100.079% ( 22000, 33000 ] 7 0.001% 100.080% ** Level 5 read latency histogram (micros): Count: 177351 Average: 439.6835 StdDev: 826.73 Min: 73 Median: 169.4305 Max: 43939 Percentiles: P50: 169.43 P75: 371.97 P99: 4226.98 P99.9: 6849.95 P99.99: 13497.68 ------------------------------------------------------ ( 51, 76 ] 12 0.007% 0.007% ( 76, 110 ] 20781 11.717% 11.724% ## ( 110, 170 ] 68533 38.643% 50.367% ######## ( 170, 250 ] 29616 16.699% 67.066% ### ( 250, 380 ] 14998 8.457% 75.523% ## ( 380, 580 ] 14460 8.153% 83.676% ## ( 580, 870 ] 9870 5.565% 89.241% # ( 870, 1300 ] 6903 3.892% 93.133% # ( 1300, 1900 ] 3967 2.237% 95.370% ( 1900, 2900 ] 3335 1.880% 97.251% ( 2900, 4400 ] 3507 1.977% 99.228% ( 4400, 6600 ] 1179 0.665% 99.893% ( 6600, 9900 ] 167 0.094% 99.987% ( 9900, 14000 ] 6 0.003% 99.990% ( 14000, 22000 ] 14 0.008% 99.998% ( 22000, 33000 ] 10 0.006% 100.004% ( 33000, 50000 ] 6 0.003% 100.007% ** DB Stats ** Uptime(secs): 28.2 total, 5.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 174.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.516 H:M:S, 33.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 197.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.470 H:M:S, 29.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/07-15:17:55 ... thread 0: (1000000,6000000) ops and (143727.8,171560.7) ops/second in (6.957596,34.973046) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.75 GB 201.4 4.4 0.0 4.4 10.0 5.7 0.0 1.8 99.9 229.3 44.76 33.28 101 0.443 4541K 4520 0.0 0.0 L1 12/0 1.32 GB 135.3 3.2 2.0 1.2 3.2 2.0 0.0 1.6 122.0 121.5 26.92 16.43 5 5.385 3334K 13K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.4 1.5 105.8 105.7 3.66 1.97 3 1.218 392K 305 0.0 0.0 L3 19/1 1.06 GB 1.0 6.8 4.6 2.2 6.8 4.5 0.2 1.5 115.1 114.2 60.60 32.34 31 1.955 2960K 4195 0.0 0.0 L4 179/3 9.61 GB 1.0 8.7 5.6 3.1 8.6 5.5 0.6 1.5 118.9 117.5 74.91 41.52 56 1.338 5869K 8062 0.0 0.0 L5 1152/0 94.86 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1381/15 110.60 GB 0.0 23.5 12.4 11.0 29.0 17.9 7.5 5.1 113.9 140.6 210.84 125.54 196 1.076 17M 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.5 12.4 11.0 29.0 17.9 7.5 5.1 113.9 140.6 210.84 125.54 196 1.076 17M 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.5 12.4 11.0 23.3 12.3 0.0 0.0 130.4 129.5 184.17 109.31 112 1.644 17M 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 217.3 26.67 16.23 84 0.318 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.2 total, 35.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.95 GB write, 843.02 MB/s write, 23.46 GB read, 683.13 MB/s read, 210.8 seconds Interval compaction: 28.95 GB write, 847.65 MB/s write, 23.46 GB read, 686.87 MB/s read, 210.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 37, total-stops: 62, interval: 99 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2086078 Average: 9.5501 StdDev: 84.38 Min: 0 Median: 1.5401 Max: 21977 Percentiles: P50: 1.54 P75: 1.98 P99: 187.51 P99.9: 675.83 P99.99: 1252.92 ------------------------------------------------------ [ 0, 1 ] 397894 19.074% 19.074% #### ( 1, 2 ] 1194448 57.258% 76.332% ########### ( 2, 3 ] 225010 10.786% 87.118% ## ( 3, 4 ] 105077 5.037% 92.155% # ( 4, 6 ] 82289 3.945% 96.100% # ( 6, 10 ] 17037 0.817% 96.917% ( 10, 15 ] 3140 0.151% 97.067% ( 15, 22 ] 436 0.021% 97.088% ( 22, 34 ] 45 0.002% 97.090% ( 34, 51 ] 28 0.001% 97.091% ( 51, 76 ] 31 0.001% 97.093% ( 76, 110 ] 7837 0.376% 97.469% ( 110, 170 ] 29349 1.407% 98.876% ( 170, 250 ] 11863 0.569% 99.444% ( 250, 380 ] 4908 0.235% 99.679% ( 380, 580 ] 4021 0.193% 99.872% ( 580, 870 ] 1752 0.084% 99.956% ( 870, 1300 ] 791 0.038% 99.994% ( 1300, 1900 ] 344 0.016% 100.011% ( 1900, 2900 ] 290 0.014% 100.025% ( 2900, 4400 ] 264 0.013% 100.037% ( 4400, 6600 ] 70 0.003% 100.041% ( 6600, 9900 ] 15 0.001% 100.041% ( 9900, 14000 ] 3 0.000% 100.041% ( 14000, 22000 ] 6 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 492553 Average: 7.8623 StdDev: 119.74 Min: 1 Median: 1.8112 Max: 31061 Percentiles: P50: 1.81 P75: 2.86 P99: 120.19 P99.9: 986.19 P99.99: 3922.28 ------------------------------------------------------ [ 0, 1 ] 31901 6.477% 6.477% # ( 1, 2 ] 264267 53.653% 60.129% ########### ( 2, 3 ] 84987 17.254% 77.384% ### ( 3, 4 ] 44729 9.081% 86.465% ## ( 4, 6 ] 45932 9.325% 95.790% ## ( 6, 10 ] 11692 2.374% 98.164% ( 10, 15 ] 2236 0.454% 98.618% ( 15, 22 ] 680 0.138% 98.756% ( 22, 34 ] 67 0.014% 98.769% ( 34, 51 ] 12 0.002% 98.772% ( 51, 76 ] 13 0.003% 98.774% ( 76, 110 ] 686 0.139% 98.914% ( 110, 170 ] 2506 0.509% 99.422% ( 170, 250 ] 1017 0.206% 99.629% ( 250, 380 ] 502 0.102% 99.731% ( 380, 580 ] 448 0.091% 99.822% ( 580, 870 ] 326 0.066% 99.888% ( 870, 1300 ] 220 0.045% 99.933% ( 1300, 1900 ] 131 0.027% 99.959% ( 1900, 2900 ] 87 0.018% 99.977% ( 2900, 4400 ] 95 0.019% 99.996% ( 4400, 6600 ] 26 0.005% 100.001% ( 6600, 9900 ] 4 0.001% 100.002% ( 14000, 22000 ] 2 0.000% 100.003% ( 22000, 33000 ] 4 0.001% 100.003% ** Level 2 read latency histogram (micros): Count: 1012624 Average: 14.5552 StdDev: 202.76 Min: 1 Median: 1.9019 Max: 43531 Percentiles: P50: 1.90 P75: 3.00 P99: 13.07 P99.9: 1873.15 P99.99: 2861.04 ------------------------------------------------------ [ 0, 1 ] 41192 4.068% 4.068% # ( 1, 2 ] 515693 50.926% 54.994% ########## ( 2, 3 ] 203171 20.064% 75.058% #### ( 3, 4 ] 107514 10.617% 85.675% ## ( 4, 6 ] 105485 10.417% 96.092% ## ( 6, 10 ] 25419 2.510% 98.603% # ( 10, 15 ] 6563 0.648% 99.251% ( 15, 22 ] 840 0.083% 99.334% ( 22, 34 ] 113 0.011% 99.345% ( 34, 51 ] 76 0.008% 99.352% ( 51, 76 ] 91 0.009% 99.361% ( 76, 110 ] 122 0.012% 99.373% ( 110, 170 ] 351 0.035% 99.408% ( 170, 250 ] 304 0.030% 99.438% ( 250, 380 ] 473 0.047% 99.485% ( 380, 580 ] 837 0.083% 99.567% ( 580, 870 ] 1215 0.120% 99.687% ( 870, 1300 ] 1264 0.125% 99.812% ( 1300, 1900 ] 930 0.092% 99.904% ( 1900, 2900 ] 905 0.089% 99.993% ( 2900, 4400 ] 867 0.086% 100.079% ( 4400, 6600 ] 276 0.027% 100.106% ( 6600, 9900 ] 54 0.005% 100.112% ( 9900, 14000 ] 2 0.000% 100.112% ( 14000, 22000 ] 9 0.001% 100.113% ( 22000, 33000 ] 6 0.001% 100.113% ( 33000, 50000 ] 2 0.000% 100.114% ** Level 3 read latency histogram (micros): Count: 1975187 Average: 11.7911 StdDev: 175.16 Min: 1 Median: 1.9001 Max: 38333 Percentiles: P50: 1.90 P75: 2.97 P99: 11.95 P99.9: 1113.89 P99.99: 1834.00 ------------------------------------------------------ [ 0, 1 ] 62300 3.154% 3.154% # ( 1, 2 ] 1027993 52.045% 55.199% ########## ( 2, 3 ] 402768 20.391% 75.591% #### ( 3, 4 ] 208503 10.556% 86.147% ## ( 4, 6 ] 205899 10.424% 96.571% ## ( 6, 10 ] 43888 2.222% 98.793% ( 10, 15 ] 10465 0.530% 99.323% ( 15, 22 ] 1134 0.057% 99.380% ( 22, 34 ] 109 0.006% 99.386% ( 34, 51 ] 151 0.008% 99.394% ( 51, 76 ] 192 0.010% 99.403% ( 76, 110 ] 755 0.038% 99.442% ( 110, 170 ] 2455 0.124% 99.566% ( 170, 250 ] 1294 0.066% 99.631% ( 250, 380 ] 924 0.047% 99.678% ( 380, 580 ] 1464 0.074% 99.752% ( 580, 870 ] 1919 0.097% 99.849% ( 870, 1300 ] 1761 0.089% 99.939% ( 1300, 1900 ] 1141 0.058% 99.996% ( 1900, 2900 ] 1269 0.064% 100.061% ( 2900, 4400 ] 1354 0.069% 100.129% ( 4400, 6600 ] 380 0.019% 100.148% ( 6600, 9900 ] 62 0.003% 100.152% ( 9900, 14000 ] 7 0.000% 100.152% ( 14000, 22000 ] 11 0.001% 100.152% ( 22000, 33000 ] 10 0.001% 100.153% ( 33000, 50000 ] 4 0.000% 100.153% ** Level 4 read latency histogram (micros): Count: 855038 Average: 32.3697 StdDev: 242.05 Min: 0 Median: 1.9432 Max: 31958 Percentiles: P50: 1.94 P75: 3.35 P99: 658.19 P99.9: 2993.54 P99.99: 3980.12 ------------------------------------------------------ [ 0, 1 ] 30058 3.515% 3.515% # ( 1, 2 ] 421417 49.286% 52.802% ########## ( 2, 3 ] 159702 18.678% 71.480% #### ( 3, 4 ] 85222 9.967% 81.447% ## ( 4, 6 ] 82660 9.667% 91.114% ## ( 6, 10 ] 18088 2.115% 93.229% ( 10, 15 ] 4045 0.473% 93.703% ( 15, 22 ] 444 0.052% 93.754% ( 22, 34 ] 45 0.005% 93.760% ( 34, 51 ] 72 0.008% 93.768% ( 51, 76 ] 105 0.012% 93.780% ( 76, 110 ] 6123 0.716% 94.497% ( 110, 170 ] 20076 2.348% 96.844% ( 170, 250 ] 8551 1.000% 97.845% ( 250, 380 ] 4479 0.524% 98.368% ( 380, 580 ] 4496 0.526% 98.894% ( 580, 870 ] 3355 0.392% 99.287% ( 870, 1300 ] 2536 0.297% 99.583% ( 1300, 1900 ] 1455 0.170% 99.753% ( 1900, 2900 ] 1181 0.138% 99.891% ( 2900, 4400 ] 1170 0.137% 100.028% ( 4400, 6600 ] 340 0.040% 100.068% ( 6600, 9900 ] 52 0.006% 100.074% ( 9900, 14000 ] 3 0.000% 100.074% ( 14000, 22000 ] 7 0.001% 100.075% ( 22000, 33000 ] 7 0.001% 100.076% ** Level 5 read latency histogram (micros): Count: 256905 Average: 368.3743 StdDev: 704.41 Min: 73 Median: 164.3328 Max: 43939 Percentiles: P50: 164.33 P75: 306.74 P99: 3896.87 P99.9: 6503.15 P99.99: 9833.45 ------------------------------------------------------ ( 51, 76 ] 17 0.007% 0.007% ( 76, 110 ] 32069 12.483% 12.489% ## ( 110, 170 ] 106418 41.423% 53.913% ######## ( 170, 250 ] 44588 17.356% 71.268% ### ( 250, 380 ] 21965 8.550% 79.818% ## ( 380, 580 ] 20068 7.811% 87.630% ## ( 580, 870 ] 12020 4.679% 92.308% # ( 870, 1300 ] 7388 2.876% 95.184% # ( 1300, 1900 ] 4053 1.578% 96.762% ( 1900, 2900 ] 3402 1.324% 98.086% ( 2900, 4400 ] 3533 1.375% 99.461% ( 4400, 6600 ] 1179 0.459% 99.920% ( 6600, 9900 ] 183 0.071% 99.991% ( 9900, 14000 ] 6 0.002% 99.994% ( 14000, 22000 ] 14 0.005% 99.999% ( 22000, 33000 ] 10 0.004% 100.003% ( 33000, 50000 ] 6 0.002% 100.005% ** DB Stats ** Uptime(secs): 35.2 total, 7.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 167.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.811 H:M:S, 36.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 141.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.295 H:M:S, 47.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 281.754 micros/op 14187 ops/sec 60.124 seconds 852996 operations; 13.7 MB/s (211999 of 211999 found) Microseconds per read: Count: 852996 Average: 281.7564 StdDev: 791.38 Min: 1 Median: 182.0565 Max: 68267 Percentiles: P50: 182.06 P75: 241.94 P99: 2116.50 P99.9: 12426.01 P99.99: 30606.27 ------------------------------------------------------ [ 0, 1 ] 1 0.000% 0.000% ( 1, 2 ] 8 0.001% 0.001% ( 2, 3 ] 34 0.004% 0.005% ( 3, 4 ] 34 0.004% 0.009% ( 4, 6 ] 74 0.009% 0.018% ( 6, 10 ] 403 0.047% 0.065% ( 10, 15 ] 2142 0.251% 0.316% ( 15, 22 ] 3052 0.358% 0.674% ( 22, 34 ] 5968 0.700% 1.374% ( 34, 51 ] 3094 0.363% 1.736% ( 51, 76 ] 299 0.035% 1.771% ( 76, 110 ] 15989 1.874% 3.646% ( 110, 170 ] 352468 41.321% 44.967% ######## ( 170, 250 ] 284872 33.397% 78.364% ####### ( 250, 380 ] 94959 11.132% 89.496% ## ( 380, 580 ] 44579 5.226% 94.722% # ( 580, 870 ] 20820 2.441% 97.163% ( 870, 1300 ] 10231 1.199% 98.362% ( 1300, 1900 ] 4696 0.551% 98.913% ( 1900, 2900 ] 3432 0.402% 99.315% ( 2900, 4400 ] 3253 0.381% 99.697% ( 4400, 6600 ] 1038 0.122% 99.818% ( 6600, 9900 ] 429 0.050% 99.869% ( 9900, 14000 ] 435 0.051% 99.920% ( 14000, 22000 ] 463 0.054% 99.974% ( 22000, 33000 ] 176 0.021% 99.994% ( 33000, 50000 ] 39 0.005% 99.999% ( 50000, 75000 ] 8 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14679952 rocksdb.bloom.filter.full.positive COUNT : 995950 rocksdb.bloom.filter.full.true.positive COUNT : 852615 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 381 rocksdb.memtable.miss COUNT : 852615 rocksdb.l0.hit COUNT : 31469 rocksdb.l1.hit COUNT : 9775 rocksdb.l2andup.hit COUNT : 811371 rocksdb.compaction.key.drop.new COUNT : 201386 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6496387 rocksdb.number.keys.read COUNT : 852996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6704271384 rocksdb.bytes.read COUNT : 852996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1773 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35612343 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28332612003 rocksdb.compact.write.bytes COUNT : 28121863019 rocksdb.flush.write.bytes COUNT : 6671893658 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 43 rocksdb.number.superversion_acquires COUNT : 1355 rocksdb.number.superversion_releases COUNT : 1309 rocksdb.number.superversion_cleanups COUNT : 337 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 391 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6617962496 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2454528 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32304939975 rocksdb.non.last.level.read.count COUNT : 7663527 rocksdb.block.checksum.compute.count COUNT : 7868207 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 180.551147 P95 : 611.328059 P99 : 2115.275269 P100 : 68265.000000 COUNT : 852996 SUM : 239545729 rocksdb.db.write.micros P50 : 1.549893 P95 : 4.169870 P99 : 8.400987 P100 : 846203.000000 COUNT : 6496387 SUM : 51947674 rocksdb.compaction.times.micros P50 : 1300000.000000 P95 : 3740000.000000 P99 : 13328000.000000 P100 : 14546973.000000 COUNT : 116 SUM : 193664680 rocksdb.compaction.times.cpu_micros P50 : 794339.622642 P95 : 2100000.000000 P99 : 7886000.000000 P100 : 9215604.000000 COUNT : 116 SUM : 118298663 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 793.235294 P95 : 25850.000000 P99 : 212800.000000 P100 : 236383.000000 COUNT : 93 SUM : 846196 rocksdb.compaction.outfile.sync.micros P50 : 17684.210526 P95 : 220933.333333 P99 : 437380.000000 P100 : 454912.000000 COUNT : 349 SUM : 18667089 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 320.909091 P95 : 4037.500000 P99 : 6480.571429 P100 : 8463.000000 COUNT : 238 SUM : 238085 rocksdb.table.open.io.micros P50 : 8100.884086 P95 : 19503.636364 P99 : 23314.210526 P100 : 42771.000000 COUNT : 1773 SUM : 14678197 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.875083 P95 : 9.885318 P99 : 162.176707 P100 : 38342.000000 COUNT : 6860547 SUM : 100280307 rocksdb.read.block.get.micros P50 : 142.386490 P95 : 511.584036 P99 : 1888.862230 P100 : 43942.000000 COUNT : 1005858 SUM : 206446722 rocksdb.write.raw.block.micros P50 : 0.526407 P95 : 1.005280 P99 : 3.510223 P100 : 52873.000000 COUNT : 8427082 SUM : 25472479 rocksdb.numfiles.in.singlecompaction P50 : 2.854839 P95 : 5.722222 P99 : 13.875000 P100 : 24.000000 COUNT : 145 SUM : 514 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.575050 P95 : 1273.981329 P99 : 2687.756013 P100 : 846044.000000 COUNT : 158661 SUM : 35627222 rocksdb.sst.read.micros P50 : 1.909728 P95 : 159.541344 P99 : 497.099983 P100 : 43939.000000 COUNT : 7663552 SUM : 287231658 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 852996 SUM : 852996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6496387 SUM : 6704271384 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221666.666667 P95 : 936500.000000 P99 : 1147300.000000 P100 : 1151782.000000 COUNT : 93 SUM : 28535728 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 395 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0