[2024-07-10 12:25:23.783170] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 22.11.4 initialization... [2024-07-10 12:25:23.783310] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid830741 ] Set seed to 1720607123779735 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-10 12:25:23.904989] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-10 12:25:23.951011] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-10 12:25:23.951067] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 830741' to capture a snapshot of events at runtime. [2024-07-10 12:25:23.951083] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-10 12:25:23.951098] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-10 12:25:23.951110] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid830741 for offline analysis/debug. [2024-07-10 12:25:23.951219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 10 12:25:28 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/10-12:25:32 ... thread 0: (1000000,1000000) ops and (263403.3,263403.3) ops/second in (3.796460,3.796460) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/13 819.06 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 314.2 2.81 2.48 14 0.201 0 0 0.0 0.0 L2 1/0 49.11 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 101.6 101.5 1.10 1.06 1 1.097 113K 28 0.0 0.0 L3 23/1 1007.20 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 144.8 144.8 0.43 0.38 1 0.430 63K 0 0.0 0.0 L4 156/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1124/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/14 97.00 GB 0.0 0.2 0.1 0.0 1.0 1.0 0.0 1.2 40.1 243.5 4.34 3.92 16 0.271 176K 28 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.1 0.0 1.0 1.0 0.0 1.2 40.1 243.5 4.34 3.92 16 0.271 176K 28 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.1 0.0 0.2 0.1 0.0 0.0 113.8 113.7 1.53 1.44 2 0.764 176K 28 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 314.2 2.81 2.48 14 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.1 total, 3.8 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.03 GB write, 259.02 MB/s write, 0.17 GB read, 42.63 MB/s read, 4.3 seconds Interval compaction: 1.03 GB write, 277.90 MB/s write, 0.17 GB read, 45.74 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 139720 Average: 4.0531 StdDev: 21.04 Min: 1 Median: 3.1409 Max: 3679 Percentiles: P50: 3.14 P75: 3.97 P99: 9.92 P99.9: 14.87 P99.99: 18.95 ------------------------------------------------------ [ 0, 1 ] 188 0.135% 0.135% ( 1, 2 ] 28954 20.723% 20.857% #### ( 2, 3 ] 34796 24.904% 45.762% ##### ( 3, 4 ] 42045 30.092% 75.854% ###### ( 4, 6 ] 23997 17.175% 93.029% ### ( 6, 10 ] 8518 6.096% 99.125% # ( 10, 15 ] 1115 0.798% 99.923% ( 15, 22 ] 172 0.123% 100.047% ( 22, 34 ] 20 0.014% 100.061% ( 34, 51 ] 3 0.002% 100.063% ( 51, 76 ] 1 0.001% 100.064% ( 76, 110 ] 1 0.001% 100.064% ( 110, 170 ] 8 0.006% 100.070% ( 170, 250 ] 5 0.004% 100.074% ( 250, 380 ] 4 0.003% 100.077% ( 380, 580 ] 1 0.001% 100.077% ( 580, 870 ] 3 0.002% 100.079% ( 870, 1300 ] 1 0.001% 100.080% ( 1900, 2900 ] 1 0.001% 100.081% ( 2900, 4400 ] 5 0.004% 100.084% ** Level 1 read latency histogram (micros): Count: 12312 Average: 5.9512 StdDev: 30.84 Min: 3 Median: 3.6769 Max: 2022 Percentiles: P50: 3.68 P75: 4.70 P99: 25.12 P99.9: 186.88 P99.99: 2022.00 ------------------------------------------------------ ( 2, 3 ] 1112 9.032% 9.032% ## ( 3, 4 ] 7452 60.526% 69.558% ############ ( 4, 6 ] 1915 15.554% 85.112% ### ( 6, 10 ] 1351 10.973% 96.085% ## ( 10, 15 ] 192 1.559% 97.645% ( 15, 22 ] 150 1.218% 98.863% ( 22, 34 ] 65 0.528% 99.391% ( 34, 51 ] 4 0.032% 99.423% ( 51, 76 ] 32 0.260% 99.683% ( 76, 110 ] 20 0.162% 99.846% ( 110, 170 ] 5 0.041% 99.886% ( 170, 250 ] 8 0.065% 99.951% ( 250, 380 ] 2 0.016% 99.968% ( 580, 870 ] 1 0.008% 99.976% ( 1300, 1900 ] 1 0.008% 99.984% ( 1900, 2900 ] 2 0.016% 100.000% ** Level 2 read latency histogram (micros): Count: 15827 Average: 3.1829 StdDev: 5.58 Min: 1 Median: 2.2427 Max: 393 Percentiles: P50: 2.24 P75: 2.87 P99: 9.60 P99.9: 16.17 P99.99: 354.75 ------------------------------------------------------ [ 0, 1 ] 62 0.392% 0.392% ( 1, 2 ] 6332 40.008% 40.399% ######## ( 2, 3 ] 6262 39.565% 79.965% ######## ( 3, 4 ] 1358 8.580% 88.545% ## ( 4, 6 ] 1095 6.919% 95.463% # ( 6, 10 ] 622 3.930% 99.393% # ( 10, 15 ] 79 0.499% 99.893% ( 15, 22 ] 7 0.044% 99.937% ( 22, 34 ] 2 0.013% 99.949% ( 34, 51 ] 3 0.019% 99.968% ( 51, 76 ] 1 0.006% 99.975% ( 250, 380 ] 3 0.019% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 14313 Average: 13.2969 StdDev: 136.49 Min: 1 Median: 3.6198 Max: 4319 Percentiles: P50: 3.62 P75: 5.04 P99: 14.83 P99.9: 2528.65 P99.99: 4131.63 ------------------------------------------------------ [ 0, 1 ] 5 0.035% 0.035% ( 1, 2 ] 413 2.885% 2.920% # ( 2, 3 ] 3657 25.550% 28.471% ##### ( 3, 4 ] 4972 34.738% 63.208% ####### ( 4, 6 ] 3240 22.637% 85.845% ##### ( 6, 10 ] 1620 11.318% 97.163% ## ( 10, 15 ] 272 1.900% 99.064% ( 15, 22 ] 47 0.328% 99.392% ( 22, 34 ] 7 0.049% 99.441% ( 34, 51 ] 1 0.007% 99.448% ( 170, 250 ] 1 0.007% 99.455% ( 250, 380 ] 7 0.049% 99.504% ( 380, 580 ] 4 0.028% 99.532% ( 580, 870 ] 7 0.049% 99.581% ( 870, 1300 ] 19 0.133% 99.714% ( 1300, 1900 ] 16 0.112% 99.825% ( 1900, 2900 ] 17 0.119% 99.944% ( 2900, 4400 ] 8 0.056% 100.000% ** Level 4 read latency histogram (micros): Count: 160 Average: 5.0312 StdDev: 15.95 Min: 2 Median: 2.7571 Max: 204 Percentiles: P50: 2.76 P75: 3.59 P99: 19.90 P99.9: 204.00 P99.99: 204.00 ------------------------------------------------------ ( 1, 2 ] 27 16.875% 16.875% ### ( 2, 3 ] 70 43.750% 60.625% ######### ( 3, 4 ] 39 24.375% 85.000% ##### ( 4, 6 ] 14 8.750% 93.750% ## ( 6, 10 ] 4 2.500% 96.250% # ( 10, 15 ] 3 1.875% 98.125% ( 15, 22 ] 2 1.250% 99.375% ( 170, 250 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 4.1 total, 3.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 241.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 259.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/10-12:25:36 ... thread 0: (1000000,2000000) ops and (264315.9,263858.8) ops/second in (3.783352,7.579812) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 1.48 GB 6.3 1.0 0.0 1.0 2.8 1.8 0.0 1.5 91.8 264.0 10.98 10.15 34 0.323 1023K 952 0.0 0.0 L1 4/4 314.62 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.1 1.0 100.0 99.9 3.15 3.06 1 3.150 319K 395 0.0 0.0 L2 1/0 49.11 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 101.6 101.5 1.10 1.06 1 1.097 113K 28 0.0 0.0 L3 22/0 951.27 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 144.8 144.8 0.43 0.38 1 0.430 63K 0 0.0 0.0 L4 213/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 57.0 57.0 0.98 0.61 1 0.981 56K 0 0.0 0.0 L5 1124/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1376/15 97.98 GB 0.0 1.5 0.5 1.0 3.4 2.3 0.1 1.8 93.3 206.9 16.63 15.25 38 0.438 1576K 1375 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.5 1.0 3.4 2.3 0.1 1.8 93.3 206.9 16.63 15.25 38 0.438 1576K 1375 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.5 1.0 1.5 0.5 0.0 0.0 149.5 149.4 10.39 9.72 8 1.298 1576K 1375 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 302.5 6.25 5.54 30 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.36 GB write, 437.87 MB/s write, 1.52 GB read, 197.57 MB/s read, 16.6 seconds Interval compaction: 3.36 GB write, 453.86 MB/s write, 1.52 GB read, 204.78 MB/s read, 16.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 395469 Average: 3.3097 StdDev: 16.63 Min: 1 Median: 2.2824 Max: 4337 Percentiles: P50: 2.28 P75: 3.52 P99: 9.48 P99.9: 14.20 P99.99: 16.23 ------------------------------------------------------ [ 0, 1 ] 32025 8.098% 8.098% ## ( 1, 2 ] 141907 35.883% 43.981% ####### ( 2, 3 ] 84296 21.315% 65.297% #### ( 3, 4 ] 73355 18.549% 83.846% #### ( 4, 6 ] 46579 11.778% 95.624% ## ( 6, 10 ] 15365 3.885% 99.509% # ( 10, 15 ] 1844 0.466% 99.975% ( 15, 22 ] 345 0.087% 100.062% ( 22, 34 ] 38 0.010% 100.072% ( 34, 51 ] 6 0.002% 100.074% ( 51, 76 ] 1 0.000% 100.074% ( 76, 110 ] 1 0.000% 100.074% ( 110, 170 ] 9 0.002% 100.076% ( 170, 250 ] 19 0.005% 100.081% ( 250, 380 ] 9 0.002% 100.083% ( 380, 580 ] 4 0.001% 100.084% ( 580, 870 ] 10 0.003% 100.087% ( 870, 1300 ] 7 0.002% 100.089% ( 1300, 1900 ] 1 0.000% 100.089% ( 1900, 2900 ] 2 0.001% 100.090% ( 2900, 4400 ] 7 0.002% 100.091% ** Level 1 read latency histogram (micros): Count: 17684 Average: 5.7606 StdDev: 29.61 Min: 3 Median: 3.6629 Max: 2022 Percentiles: P50: 3.66 P75: 4.50 P99: 20.78 P99.9: 193.16 P99.99: 2015.80 ------------------------------------------------------ ( 2, 3 ] 1601 9.053% 9.053% ## ( 3, 4 ] 10924 61.773% 70.827% ############ ( 4, 6 ] 2938 16.614% 87.441% ### ( 6, 10 ] 1642 9.285% 96.726% ## ( 10, 15 ] 261 1.476% 98.202% ( 15, 22 ] 171 0.967% 99.169% ( 22, 34 ] 66 0.373% 99.542% ( 34, 51 ] 4 0.023% 99.565% ( 51, 76 ] 32 0.181% 99.746% ( 76, 110 ] 20 0.113% 99.859% ( 110, 170 ] 5 0.028% 99.887% ( 170, 250 ] 8 0.045% 99.932% ( 250, 380 ] 4 0.023% 99.955% ( 580, 870 ] 4 0.023% 99.977% ( 870, 1300 ] 1 0.006% 99.983% ( 1300, 1900 ] 1 0.006% 99.989% ( 1900, 2900 ] 2 0.011% 100.000% ** Level 2 read latency histogram (micros): Count: 15827 Average: 3.1829 StdDev: 5.58 Min: 1 Median: 2.2427 Max: 393 Percentiles: P50: 2.24 P75: 2.87 P99: 9.60 P99.9: 16.17 P99.99: 354.75 ------------------------------------------------------ [ 0, 1 ] 62 0.392% 0.392% ( 1, 2 ] 6332 40.008% 40.399% ######## ( 2, 3 ] 6262 39.565% 79.965% ######## ( 3, 4 ] 1358 8.580% 88.545% ## ( 4, 6 ] 1095 6.919% 95.463% # ( 6, 10 ] 622 3.930% 99.393% # ( 10, 15 ] 79 0.499% 99.893% ( 15, 22 ] 7 0.044% 99.937% ( 22, 34 ] 2 0.013% 99.949% ( 34, 51 ] 3 0.019% 99.968% ( 51, 76 ] 1 0.006% 99.975% ( 250, 380 ] 3 0.019% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 14313 Average: 13.2969 StdDev: 136.49 Min: 1 Median: 3.6198 Max: 4319 Percentiles: P50: 3.62 P75: 5.04 P99: 14.83 P99.9: 2528.65 P99.99: 4131.63 ------------------------------------------------------ [ 0, 1 ] 5 0.035% 0.035% ( 1, 2 ] 413 2.885% 2.920% # ( 2, 3 ] 3657 25.550% 28.471% ##### ( 3, 4 ] 4972 34.738% 63.208% ####### ( 4, 6 ] 3240 22.637% 85.845% ##### ( 6, 10 ] 1620 11.318% 97.163% ## ( 10, 15 ] 272 1.900% 99.064% ( 15, 22 ] 47 0.328% 99.392% ( 22, 34 ] 7 0.049% 99.441% ( 34, 51 ] 1 0.007% 99.448% ( 170, 250 ] 1 0.007% 99.455% ( 250, 380 ] 7 0.049% 99.504% ( 380, 580 ] 4 0.028% 99.532% ( 580, 870 ] 7 0.049% 99.581% ( 870, 1300 ] 19 0.133% 99.714% ( 1300, 1900 ] 16 0.112% 99.825% ( 1900, 2900 ] 17 0.119% 99.944% ( 2900, 4400 ] 8 0.056% 100.000% ** Level 4 read latency histogram (micros): Count: 285 Average: 9.6421 StdDev: 58.12 Min: 2 Median: 2.8802 Max: 898 Percentiles: P50: 2.88 P75: 3.80 P99: 182.00 P99.9: 898.00 P99.99: 898.00 ------------------------------------------------------ ( 1, 2 ] 36 12.632% 12.632% ### ( 2, 3 ] 121 42.456% 55.088% ######## ( 3, 4 ] 71 24.912% 80.000% ##### ( 4, 6 ] 32 11.228% 91.228% ## ( 6, 10 ] 9 3.158% 94.386% # ( 10, 15 ] 8 2.807% 97.193% # ( 15, 22 ] 3 1.053% 98.246% ( 51, 76 ] 1 0.351% 98.596% ( 110, 170 ] 1 0.351% 98.947% ( 170, 250 ] 1 0.351% 99.298% ( 250, 380 ] 1 0.351% 99.649% ( 870, 1300 ] 1 0.351% 100.000% ** DB Stats ** Uptime(secs): 7.9 total, 3.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 250.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 260.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/10-12:25:39 ... thread 0: (1000000,3000000) ops and (261369.8,263023.9) ops/second in (3.825997,11.405809) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.40 GB 100.7 2.0 0.0 2.0 4.7 2.8 0.0 1.7 108.2 260.2 18.64 17.33 53 0.352 2046K 1885 0.0 0.0 L1 4/4 314.62 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.1 1.0 100.0 99.9 3.15 3.06 1 3.150 319K 395 0.0 0.0 L2 1/0 49.11 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 101.6 101.5 1.10 1.06 1 1.097 113K 28 0.0 0.0 L3 22/0 951.27 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 144.8 144.8 0.43 0.38 1 0.430 63K 0 0.0 0.0 L4 213/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 57.0 57.0 0.98 0.61 1 0.981 56K 0 0.0 0.0 L5 1124/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1379/15 98.90 GB 0.0 2.5 0.5 2.0 5.3 3.3 0.1 1.9 105.4 222.0 24.30 22.44 57 0.426 2600K 2308 0.0 0.0 Int 0/0 0.00 KB 0.0 2.5 0.5 2.0 5.3 3.3 0.1 1.9 105.4 222.0 24.30 22.44 57 0.426 2600K 2308 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.5 0.5 2.0 2.5 0.5 0.0 0.0 173.3 173.2 14.77 14.00 12 1.231 2600K 2308 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 297.8 9.52 8.44 45 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.7 total, 11.4 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.27 GB write, 461.55 MB/s write, 2.50 GB read, 219.15 MB/s read, 24.3 seconds Interval compaction: 5.27 GB write, 472.76 MB/s write, 2.50 GB read, 224.47 MB/s read, 24.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 712506 Average: 3.2509 StdDev: 14.20 Min: 1 Median: 2.2246 Max: 4337 Percentiles: P50: 2.22 P75: 3.50 P99: 9.36 P99.9: 13.61 P99.99: 14.71 ------------------------------------------------------ [ 0, 1 ] 60121 8.438% 8.438% ## ( 1, 2 ] 261101 36.645% 45.083% ####### ( 2, 3 ] 156013 21.896% 66.980% #### ( 3, 4 ] 114585 16.082% 83.062% ### ( 4, 6 ] 90825 12.747% 95.809% ### ( 6, 10 ] 27050 3.796% 99.605% # ( 10, 15 ] 2910 0.408% 100.014% ( 15, 22 ] 537 0.075% 100.089% ( 22, 34 ] 59 0.008% 100.098% ( 34, 51 ] 9 0.001% 100.099% ( 51, 76 ] 3 0.000% 100.099% ( 76, 110 ] 1 0.000% 100.099% ( 110, 170 ] 11 0.002% 100.101% ( 170, 250 ] 35 0.005% 100.106% ( 250, 380 ] 16 0.002% 100.108% ( 380, 580 ] 6 0.001% 100.109% ( 580, 870 ] 16 0.002% 100.111% ( 870, 1300 ] 11 0.002% 100.113% ( 1300, 1900 ] 2 0.000% 100.113% ( 1900, 2900 ] 4 0.001% 100.114% ( 2900, 4400 ] 8 0.001% 100.115% ** Level 1 read latency histogram (micros): Count: 37554 Average: 5.3848 StdDev: 20.36 Min: 3 Median: 3.8724 Max: 2022 Percentiles: P50: 3.87 P75: 5.19 P99: 14.97 P99.9: 88.66 P99.99: 975.18 ------------------------------------------------------ ( 2, 3 ] 1819 4.844% 4.844% # ( 3, 4 ] 19439 51.763% 56.606% ########## ( 4, 6 ] 11576 30.825% 87.431% ###### ( 6, 10 ] 3839 10.223% 97.654% ## ( 10, 15 ] 508 1.353% 99.007% ( 15, 22 ] 223 0.594% 99.601% ( 22, 34 ] 68 0.181% 99.782% ( 34, 51 ] 5 0.013% 99.795% ( 51, 76 ] 32 0.085% 99.880% ( 76, 110 ] 20 0.053% 99.933% ( 110, 170 ] 5 0.013% 99.947% ( 170, 250 ] 8 0.021% 99.968% ( 250, 380 ] 4 0.011% 99.979% ( 580, 870 ] 4 0.011% 99.989% ( 870, 1300 ] 1 0.003% 99.992% ( 1300, 1900 ] 1 0.003% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 15827 Average: 3.1829 StdDev: 5.58 Min: 1 Median: 2.2427 Max: 393 Percentiles: P50: 2.24 P75: 2.87 P99: 9.60 P99.9: 16.17 P99.99: 354.75 ------------------------------------------------------ [ 0, 1 ] 62 0.392% 0.392% ( 1, 2 ] 6332 40.008% 40.399% ######## ( 2, 3 ] 6262 39.565% 79.965% ######## ( 3, 4 ] 1358 8.580% 88.545% ## ( 4, 6 ] 1095 6.919% 95.463% # ( 6, 10 ] 622 3.930% 99.393% # ( 10, 15 ] 79 0.499% 99.893% ( 15, 22 ] 7 0.044% 99.937% ( 22, 34 ] 2 0.013% 99.949% ( 34, 51 ] 3 0.019% 99.968% ( 51, 76 ] 1 0.006% 99.975% ( 250, 380 ] 3 0.019% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 14313 Average: 13.2969 StdDev: 136.49 Min: 1 Median: 3.6198 Max: 4319 Percentiles: P50: 3.62 P75: 5.04 P99: 14.83 P99.9: 2528.65 P99.99: 4131.63 ------------------------------------------------------ [ 0, 1 ] 5 0.035% 0.035% ( 1, 2 ] 413 2.885% 2.920% # ( 2, 3 ] 3657 25.550% 28.471% ##### ( 3, 4 ] 4972 34.738% 63.208% ####### ( 4, 6 ] 3240 22.637% 85.845% ##### ( 6, 10 ] 1620 11.318% 97.163% ## ( 10, 15 ] 272 1.900% 99.064% ( 15, 22 ] 47 0.328% 99.392% ( 22, 34 ] 7 0.049% 99.441% ( 34, 51 ] 1 0.007% 99.448% ( 170, 250 ] 1 0.007% 99.455% ( 250, 380 ] 7 0.049% 99.504% ( 380, 580 ] 4 0.028% 99.532% ( 580, 870 ] 7 0.049% 99.581% ( 870, 1300 ] 19 0.133% 99.714% ( 1300, 1900 ] 16 0.112% 99.825% ( 1900, 2900 ] 17 0.119% 99.944% ( 2900, 4400 ] 8 0.056% 100.000% ** Level 4 read latency histogram (micros): Count: 285 Average: 9.6421 StdDev: 58.12 Min: 2 Median: 2.8802 Max: 898 Percentiles: P50: 2.88 P75: 3.80 P99: 182.00 P99.9: 898.00 P99.99: 898.00 ------------------------------------------------------ ( 1, 2 ] 36 12.632% 12.632% ### ( 2, 3 ] 121 42.456% 55.088% ######## ( 3, 4 ] 71 24.912% 80.000% ##### ( 4, 6 ] 32 11.228% 91.228% ## ( 6, 10 ] 9 3.158% 94.386% # ( 10, 15 ] 8 2.807% 97.193% # ( 15, 22 ] 3 1.053% 98.246% ( 51, 76 ] 1 0.351% 98.596% ( 110, 170 ] 1 0.351% 98.947% ( 170, 250 ] 1 0.351% 99.298% ( 250, 380 ] 1 0.351% 99.649% ( 870, 1300 ] 1 0.351% 100.000% ** DB Stats ** Uptime(secs): 11.7 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 252.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 257.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/10-12:25:44 ... thread 0: (1000000,4000000) ops and (196523.7,242508.7) ops/second in (5.088444,16.494253) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.38 GB 201.4 3.0 0.0 3.0 6.7 3.7 0.0 1.8 113.3 257.1 26.70 24.95 73 0.366 3070K 2897 0.0 0.0 L1 4/4 314.62 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.1 1.0 100.0 99.9 3.15 3.06 1 3.150 319K 395 0.0 0.0 L2 1/0 49.11 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 101.6 101.5 1.10 1.06 1 1.097 113K 28 0.0 0.0 L3 22/0 951.27 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 144.8 144.8 0.43 0.38 1 0.430 63K 0 0.0 0.0 L4 213/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 57.0 57.0 0.98 0.61 1 0.981 56K 0 0.0 0.0 L5 1124/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1383/15 99.89 GB 0.0 3.5 0.5 3.0 7.2 4.2 0.1 1.9 110.3 228.9 32.36 30.06 77 0.420 3623K 3320 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 0.5 3.0 7.2 4.2 0.1 1.9 110.3 228.9 32.36 30.06 77 0.420 3623K 3320 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 0.5 3.0 3.5 0.5 0.0 0.0 184.2 184.0 19.38 18.53 16 1.211 3623K 3320 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 296.0 12.98 11.53 61 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.8 total, 16.5 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.23 GB write, 441.66 MB/s write, 3.49 GB read, 212.76 MB/s read, 32.4 seconds Interval compaction: 7.23 GB write, 449.08 MB/s write, 3.49 GB read, 216.33 MB/s read, 32.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 0, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1063736 Average: 3.3061 StdDev: 14.02 Min: 1 Median: 2.2661 Max: 4337 Percentiles: P50: 2.27 P75: 3.53 P99: 9.37 P99.9: 14.10 P99.99: 16.36 ------------------------------------------------------ [ 0, 1 ] 78005 7.333% 7.333% # ( 1, 2 ] 390330 36.694% 44.027% ####### ( 2, 3 ] 238790 22.448% 66.476% #### ( 3, 4 ] 171505 16.123% 82.599% ### ( 4, 6 ] 141216 13.275% 95.874% ### ( 6, 10 ] 39422 3.706% 99.580% # ( 10, 15 ] 4150 0.390% 99.970% ( 15, 22 ] 1098 0.103% 100.073% ( 22, 34 ] 109 0.010% 100.084% ( 34, 51 ] 12 0.001% 100.085% ( 51, 76 ] 5 0.000% 100.085% ( 76, 110 ] 47 0.004% 100.090% ( 110, 170 ] 91 0.009% 100.098% ( 170, 250 ] 85 0.008% 100.106% ( 250, 380 ] 31 0.003% 100.109% ( 380, 580 ] 22 0.002% 100.111% ( 580, 870 ] 24 0.002% 100.113% ( 870, 1300 ] 17 0.002% 100.115% ( 1300, 1900 ] 3 0.000% 100.115% ( 1900, 2900 ] 5 0.000% 100.116% ( 2900, 4400 ] 11 0.001% 100.117% ** Level 1 read latency histogram (micros): Count: 63677 Average: 5.2837 StdDev: 16.75 Min: 3 Median: 3.9118 Max: 2022 Percentiles: P50: 3.91 P75: 5.22 P99: 15.17 P99.9: 74.69 P99.99: 770.84 ------------------------------------------------------ ( 2, 3 ] 2480 3.895% 3.895% # ( 3, 4 ] 32198 50.565% 54.459% ########## ( 4, 6 ] 21391 33.593% 88.052% ####### ( 6, 10 ] 6163 9.679% 97.731% ## ( 10, 15 ] 797 1.252% 98.982% ( 15, 22 ] 458 0.719% 99.702% ( 22, 34 ] 90 0.141% 99.843% ( 34, 51 ] 6 0.009% 99.852% ( 51, 76 ] 32 0.050% 99.903% ( 76, 110 ] 24 0.038% 99.940% ( 110, 170 ] 14 0.022% 99.962% ( 170, 250 ] 9 0.014% 99.976% ( 250, 380 ] 4 0.006% 99.983% ( 380, 580 ] 2 0.003% 99.986% ( 580, 870 ] 4 0.006% 99.992% ( 870, 1300 ] 2 0.003% 99.995% ( 1300, 1900 ] 1 0.002% 99.997% ( 1900, 2900 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 15827 Average: 3.1829 StdDev: 5.58 Min: 1 Median: 2.2427 Max: 393 Percentiles: P50: 2.24 P75: 2.87 P99: 9.60 P99.9: 16.17 P99.99: 354.75 ------------------------------------------------------ [ 0, 1 ] 62 0.392% 0.392% ( 1, 2 ] 6332 40.008% 40.399% ######## ( 2, 3 ] 6262 39.565% 79.965% ######## ( 3, 4 ] 1358 8.580% 88.545% ## ( 4, 6 ] 1095 6.919% 95.463% # ( 6, 10 ] 622 3.930% 99.393% # ( 10, 15 ] 79 0.499% 99.893% ( 15, 22 ] 7 0.044% 99.937% ( 22, 34 ] 2 0.013% 99.949% ( 34, 51 ] 3 0.019% 99.968% ( 51, 76 ] 1 0.006% 99.975% ( 250, 380 ] 3 0.019% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 14313 Average: 13.2969 StdDev: 136.49 Min: 1 Median: 3.6198 Max: 4319 Percentiles: P50: 3.62 P75: 5.04 P99: 14.83 P99.9: 2528.65 P99.99: 4131.63 ------------------------------------------------------ [ 0, 1 ] 5 0.035% 0.035% ( 1, 2 ] 413 2.885% 2.920% # ( 2, 3 ] 3657 25.550% 28.471% ##### ( 3, 4 ] 4972 34.738% 63.208% ####### ( 4, 6 ] 3240 22.637% 85.845% ##### ( 6, 10 ] 1620 11.318% 97.163% ## ( 10, 15 ] 272 1.900% 99.064% ( 15, 22 ] 47 0.328% 99.392% ( 22, 34 ] 7 0.049% 99.441% ( 34, 51 ] 1 0.007% 99.448% ( 170, 250 ] 1 0.007% 99.455% ( 250, 380 ] 7 0.049% 99.504% ( 380, 580 ] 4 0.028% 99.532% ( 580, 870 ] 7 0.049% 99.581% ( 870, 1300 ] 19 0.133% 99.714% ( 1300, 1900 ] 16 0.112% 99.825% ( 1900, 2900 ] 17 0.119% 99.944% ( 2900, 4400 ] 8 0.056% 100.000% ** Level 4 read latency histogram (micros): Count: 285 Average: 9.6421 StdDev: 58.12 Min: 2 Median: 2.8802 Max: 898 Percentiles: P50: 2.88 P75: 3.80 P99: 182.00 P99.9: 898.00 P99.99: 898.00 ------------------------------------------------------ ( 1, 2 ] 36 12.632% 12.632% ### ( 2, 3 ] 121 42.456% 55.088% ######## ( 3, 4 ] 71 24.912% 80.000% ##### ( 4, 6 ] 32 11.228% 91.228% ## ( 6, 10 ] 9 3.158% 94.386% # ( 10, 15 ] 8 2.807% 97.193% # ( 15, 22 ] 3 1.053% 98.246% ( 51, 76 ] 1 0.351% 98.596% ( 110, 170 ] 1 0.351% 98.947% ( 170, 250 ] 1 0.351% 99.298% ( 250, 380 ] 1 0.351% 99.649% ( 870, 1300 ] 1 0.351% 100.000% ** DB Stats ** Uptime(secs): 16.8 total, 5.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 234.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.207 H:M:S, 7.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 193.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.207 H:M:S, 23.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/10-12:25:52 ... thread 0: (1000000,5000000) ops and (129892.1,206671.8) ops/second in (7.698698,24.192951) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.20 GB 144.8 3.7 0.0 3.7 8.4 4.7 0.0 1.8 113.5 259.1 33.30 31.08 92 0.362 3838K 3631 0.0 0.0 L1 9/0 985.52 MB 98.6 1.8 1.5 0.3 1.8 1.5 0.1 1.2 98.1 97.5 18.61 18.10 2 9.305 1853K 10K 0.0 0.0 L2 1/0 49.11 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.6 1.8 101.6 101.5 1.10 1.06 1 1.097 113K 28 0.0 0.0 L3 18/0 962.45 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 144.8 144.8 0.43 0.38 1 0.430 63K 0 0.0 0.0 L4 213/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 57.0 57.0 0.98 0.61 1 0.981 56K 0 0.0 0.0 L5 1132/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1392/11 100.86 GB 0.0 5.7 1.7 4.0 10.4 6.4 2.1 2.2 107.2 196.1 54.42 51.22 97 0.561 5925K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 1.7 4.0 10.4 6.4 2.1 2.2 107.2 196.1 54.42 51.22 97 0.561 5925K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 1.7 4.0 5.7 1.6 0.0 0.0 153.9 153.5 37.93 36.60 20 1.896 5925K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 294.2 16.49 14.62 77 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.5 total, 24.2 interval Flush(GB): cumulative 4.738, interval 4.738 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.42 GB write, 436.09 MB/s write, 5.70 GB read, 238.45 MB/s read, 54.4 seconds Interval compaction: 10.42 GB write, 441.09 MB/s write, 5.70 GB read, 241.18 MB/s read, 54.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 0, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1737546 Average: 3.2293 StdDev: 12.82 Min: 1 Median: 2.1935 Max: 4495 Percentiles: P50: 2.19 P75: 3.34 P99: 9.32 P99.9: 14.65 P99.99: 17.92 ------------------------------------------------------ [ 0, 1 ] 102474 5.898% 5.898% # ( 1, 2 ] 681679 39.232% 45.130% ######## ( 2, 3 ] 437248 25.165% 70.295% ##### ( 3, 4 ] 237873 13.690% 83.985% ### ( 4, 6 ] 213310 12.277% 96.261% ## ( 6, 10 ] 57291 3.297% 99.559% # ( 10, 15 ] 6379 0.367% 99.926% ( 15, 22 ] 2687 0.155% 100.080% ( 22, 34 ] 204 0.012% 100.092% ( 34, 51 ] 15 0.001% 100.093% ( 51, 76 ] 10 0.001% 100.093% ( 76, 110 ] 105 0.006% 100.100% ( 110, 170 ] 120 0.007% 100.106% ( 170, 250 ] 117 0.007% 100.113% ( 250, 380 ] 49 0.003% 100.116% ( 380, 580 ] 33 0.002% 100.118% ( 580, 870 ] 34 0.002% 100.120% ( 870, 1300 ] 21 0.001% 100.121% ( 1300, 1900 ] 4 0.000% 100.121% ( 1900, 2900 ] 6 0.000% 100.122% ( 2900, 4400 ] 14 0.001% 100.122% ( 4400, 6600 ] 1 0.000% 100.122% ** Level 1 read latency histogram (micros): Count: 92271 Average: 5.7556 StdDev: 23.25 Min: 2 Median: 3.9718 Max: 2022 Percentiles: P50: 3.97 P75: 5.30 P99: 17.60 P99.9: 167.61 P99.99: 1180.29 ------------------------------------------------------ ( 1, 2 ] 2 0.002% 0.002% ( 2, 3 ] 2927 3.172% 3.174% # ( 3, 4 ] 44462 48.186% 51.361% ########## ( 4, 6 ] 33479 36.283% 87.644% ####### ( 6, 10 ] 9036 9.793% 97.437% ## ( 10, 15 ] 1116 1.209% 98.646% ( 15, 22 ] 878 0.952% 99.598% ( 22, 34 ] 119 0.129% 99.727% ( 34, 51 ] 6 0.007% 99.733% ( 51, 76 ] 32 0.035% 99.768% ( 76, 110 ] 43 0.047% 99.815% ( 110, 170 ] 82 0.089% 99.904% ( 170, 250 ] 33 0.036% 99.939% ( 250, 380 ] 14 0.015% 99.954% ( 380, 580 ] 10 0.011% 99.965% ( 580, 870 ] 17 0.018% 99.984% ( 870, 1300 ] 8 0.009% 99.992% ( 1300, 1900 ] 4 0.004% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 15827 Average: 3.1829 StdDev: 5.58 Min: 1 Median: 2.2427 Max: 393 Percentiles: P50: 2.24 P75: 2.87 P99: 9.60 P99.9: 16.17 P99.99: 354.75 ------------------------------------------------------ [ 0, 1 ] 62 0.392% 0.392% ( 1, 2 ] 6332 40.008% 40.399% ######## ( 2, 3 ] 6262 39.565% 79.965% ######## ( 3, 4 ] 1358 8.580% 88.545% ## ( 4, 6 ] 1095 6.919% 95.463% # ( 6, 10 ] 622 3.930% 99.393% # ( 10, 15 ] 79 0.499% 99.893% ( 15, 22 ] 7 0.044% 99.937% ( 22, 34 ] 2 0.013% 99.949% ( 34, 51 ] 3 0.019% 99.968% ( 51, 76 ] 1 0.006% 99.975% ( 250, 380 ] 3 0.019% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 14313 Average: 13.2969 StdDev: 136.49 Min: 1 Median: 3.6198 Max: 4319 Percentiles: P50: 3.62 P75: 5.04 P99: 14.83 P99.9: 2528.65 P99.99: 4131.63 ------------------------------------------------------ [ 0, 1 ] 5 0.035% 0.035% ( 1, 2 ] 413 2.885% 2.920% # ( 2, 3 ] 3657 25.550% 28.471% ##### ( 3, 4 ] 4972 34.738% 63.208% ####### ( 4, 6 ] 3240 22.637% 85.845% ##### ( 6, 10 ] 1620 11.318% 97.163% ## ( 10, 15 ] 272 1.900% 99.064% ( 15, 22 ] 47 0.328% 99.392% ( 22, 34 ] 7 0.049% 99.441% ( 34, 51 ] 1 0.007% 99.448% ( 170, 250 ] 1 0.007% 99.455% ( 250, 380 ] 7 0.049% 99.504% ( 380, 580 ] 4 0.028% 99.532% ( 580, 870 ] 7 0.049% 99.581% ( 870, 1300 ] 19 0.133% 99.714% ( 1300, 1900 ] 16 0.112% 99.825% ( 1900, 2900 ] 17 0.119% 99.944% ( 2900, 4400 ] 8 0.056% 100.000% ** Level 4 read latency histogram (micros): Count: 285 Average: 9.6421 StdDev: 58.12 Min: 2 Median: 2.8802 Max: 898 Percentiles: P50: 2.88 P75: 3.80 P99: 182.00 P99.9: 898.00 P99.99: 898.00 ------------------------------------------------------ ( 1, 2 ] 36 12.632% 12.632% ### ( 2, 3 ] 121 42.456% 55.088% ######## ( 3, 4 ] 71 24.912% 80.000% ##### ( 4, 6 ] 32 11.228% 91.228% ## ( 6, 10 ] 9 3.158% 94.386% # ( 10, 15 ] 8 2.807% 97.193% # ( 15, 22 ] 3 1.053% 98.246% ( 51, 76 ] 1 0.351% 98.596% ( 110, 170 ] 1 0.351% 98.947% ( 170, 250 ] 1 0.351% 99.298% ( 250, 380 ] 1 0.351% 99.649% ( 870, 1300 ] 1 0.351% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 705.3750 StdDev: 795.30 Min: 103 Median: 324.2857 Max: 2575 Percentiles: P50: 324.29 P75: 773.33 P99: 2575.00 P99.9: 2575.00 P99.99: 2575.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 6 15.000% 20.000% ### ( 170, 250 ] 8 20.000% 40.000% #### ( 250, 380 ] 7 17.500% 57.500% #### ( 380, 580 ] 3 7.500% 65.000% ## ( 580, 870 ] 6 15.000% 80.000% ### ( 1900, 2900 ] 8 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 24.5 total, 7.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 201.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.905 H:M:S, 20.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.698 H:M:S, 48.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/10-12:25:57 ... thread 0: (1000000,6000000) ops and (210979.2,207377.4) ops/second in (4.739803,28.932754) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 4.05 GB 31.5 6.0 0.0 6.0 11.6 5.6 0.0 2.1 125.6 243.1 48.66 45.88 109 0.446 6203K 15K 0.0 0.0 L1 9/9 985.52 MB 0.0 1.8 1.5 0.3 1.8 1.5 0.1 1.2 98.1 97.5 18.61 18.10 2 9.305 1853K 10K 0.0 0.0 L2 1/0 49.11 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.6 1.8 101.6 101.5 1.10 1.06 1 1.097 113K 28 0.0 0.0 L3 18/0 962.45 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 144.8 144.8 0.43 0.38 1 0.430 63K 0 0.0 0.0 L4 213/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 57.0 57.0 0.98 0.61 1 0.981 56K 0 0.0 0.0 L5 1132/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1390/24 101.71 GB 0.0 8.0 1.7 6.3 13.5 7.2 2.1 2.4 117.0 198.8 69.78 66.02 114 0.612 8290K 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 1.7 6.3 13.5 7.2 2.1 2.4 117.0 198.8 69.78 66.02 114 0.612 8290K 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 1.7 6.3 7.9 1.6 0.0 0.0 164.9 164.4 49.52 47.99 24 2.063 8290K 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 283.1 20.25 18.04 90 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.2 total, 28.9 interval Flush(GB): cumulative 5.599, interval 5.599 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.55 GB write, 474.88 MB/s write, 7.97 GB read, 279.50 MB/s read, 69.8 seconds Interval compaction: 13.55 GB write, 479.42 MB/s write, 7.97 GB read, 282.18 MB/s read, 69.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 3, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2178924 Average: 3.1120 StdDev: 13.84 Min: 1 Median: 2.0517 Max: 6089 Percentiles: P50: 2.05 P75: 3.02 P99: 9.13 P99.9: 14.51 P99.99: 18.23 ------------------------------------------------------ [ 0, 1 ] 151535 6.955% 6.955% # ( 1, 2 ] 908461 41.693% 48.648% ######## ( 2, 3 ] 569751 26.148% 74.796% ##### ( 3, 4 ] 251715 11.552% 86.348% ## ( 4, 6 ] 227591 10.445% 96.793% ## ( 6, 10 ] 61360 2.816% 99.609% # ( 10, 15 ] 7028 0.323% 99.932% ( 15, 22 ] 2749 0.126% 100.058% ( 22, 34 ] 209 0.010% 100.068% ( 34, 51 ] 18 0.001% 100.069% ( 51, 76 ] 17 0.001% 100.069% ( 76, 110 ] 170 0.008% 100.077% ( 110, 170 ] 225 0.010% 100.087% ( 170, 250 ] 161 0.007% 100.095% ( 250, 380 ] 80 0.004% 100.098% ( 380, 580 ] 61 0.003% 100.101% ( 580, 870 ] 54 0.002% 100.104% ( 870, 1300 ] 28 0.001% 100.105% ( 1300, 1900 ] 7 0.000% 100.105% ( 1900, 2900 ] 6 0.000% 100.106% ( 2900, 4400 ] 16 0.001% 100.106% ( 4400, 6600 ] 3 0.000% 100.107% ** Level 1 read latency histogram (micros): Count: 92272 Average: 5.7617 StdDev: 23.32 Min: 2 Median: 3.9718 Max: 2022 Percentiles: P50: 3.97 P75: 5.30 P99: 17.61 P99.9: 168.34 P99.99: 1180.29 ------------------------------------------------------ ( 1, 2 ] 2 0.002% 0.002% ( 2, 3 ] 2927 3.172% 3.174% # ( 3, 4 ] 44462 48.186% 51.360% ########## ( 4, 6 ] 33479 36.283% 87.643% ####### ( 6, 10 ] 9036 9.793% 97.436% ## ( 10, 15 ] 1116 1.209% 98.645% ( 15, 22 ] 878 0.952% 99.597% ( 22, 34 ] 119 0.129% 99.726% ( 34, 51 ] 6 0.007% 99.732% ( 51, 76 ] 32 0.035% 99.767% ( 76, 110 ] 43 0.047% 99.814% ( 110, 170 ] 82 0.089% 99.902% ( 170, 250 ] 33 0.036% 99.938% ( 250, 380 ] 14 0.015% 99.953% ( 380, 580 ] 11 0.012% 99.965% ( 580, 870 ] 17 0.018% 99.984% ( 870, 1300 ] 8 0.009% 99.992% ( 1300, 1900 ] 4 0.004% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 15827 Average: 3.1829 StdDev: 5.58 Min: 1 Median: 2.2427 Max: 393 Percentiles: P50: 2.24 P75: 2.87 P99: 9.60 P99.9: 16.17 P99.99: 354.75 ------------------------------------------------------ [ 0, 1 ] 62 0.392% 0.392% ( 1, 2 ] 6332 40.008% 40.399% ######## ( 2, 3 ] 6262 39.565% 79.965% ######## ( 3, 4 ] 1358 8.580% 88.545% ## ( 4, 6 ] 1095 6.919% 95.463% # ( 6, 10 ] 622 3.930% 99.393% # ( 10, 15 ] 79 0.499% 99.893% ( 15, 22 ] 7 0.044% 99.937% ( 22, 34 ] 2 0.013% 99.949% ( 34, 51 ] 3 0.019% 99.968% ( 51, 76 ] 1 0.006% 99.975% ( 250, 380 ] 3 0.019% 99.994% ( 380, 580 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 14313 Average: 13.2969 StdDev: 136.49 Min: 1 Median: 3.6198 Max: 4319 Percentiles: P50: 3.62 P75: 5.04 P99: 14.83 P99.9: 2528.65 P99.99: 4131.63 ------------------------------------------------------ [ 0, 1 ] 5 0.035% 0.035% ( 1, 2 ] 413 2.885% 2.920% # ( 2, 3 ] 3657 25.550% 28.471% ##### ( 3, 4 ] 4972 34.738% 63.208% ####### ( 4, 6 ] 3240 22.637% 85.845% ##### ( 6, 10 ] 1620 11.318% 97.163% ## ( 10, 15 ] 272 1.900% 99.064% ( 15, 22 ] 47 0.328% 99.392% ( 22, 34 ] 7 0.049% 99.441% ( 34, 51 ] 1 0.007% 99.448% ( 170, 250 ] 1 0.007% 99.455% ( 250, 380 ] 7 0.049% 99.504% ( 380, 580 ] 4 0.028% 99.532% ( 580, 870 ] 7 0.049% 99.581% ( 870, 1300 ] 19 0.133% 99.714% ( 1300, 1900 ] 16 0.112% 99.825% ( 1900, 2900 ] 17 0.119% 99.944% ( 2900, 4400 ] 8 0.056% 100.000% ** Level 4 read latency histogram (micros): Count: 285 Average: 9.6421 StdDev: 58.12 Min: 2 Median: 2.8802 Max: 898 Percentiles: P50: 2.88 P75: 3.80 P99: 182.00 P99.9: 898.00 P99.99: 898.00 ------------------------------------------------------ ( 1, 2 ] 36 12.632% 12.632% ### ( 2, 3 ] 121 42.456% 55.088% ######## ( 3, 4 ] 71 24.912% 80.000% ##### ( 4, 6 ] 32 11.228% 91.228% ## ( 6, 10 ] 9 3.158% 94.386% # ( 10, 15 ] 8 2.807% 97.193% # ( 15, 22 ] 3 1.053% 98.246% ( 51, 76 ] 1 0.351% 98.596% ( 110, 170 ] 1 0.351% 98.947% ( 170, 250 ] 1 0.351% 99.298% ( 250, 380 ] 1 0.351% 99.649% ( 870, 1300 ] 1 0.351% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 705.3750 StdDev: 795.30 Min: 103 Median: 324.2857 Max: 2575 Percentiles: P50: 324.29 P75: 773.33 P99: 2575.00 P99.9: 2575.00 P99.99: 2575.00 ------------------------------------------------------ ( 76, 110 ] 2 5.000% 5.000% # ( 110, 170 ] 6 15.000% 20.000% ### ( 170, 250 ] 8 20.000% 40.000% #### ( 250, 380 ] 7 17.500% 57.500% #### ( 380, 580 ] 3 7.500% 65.000% ## ( 580, 870 ] 6 15.000% 80.000% ### ( 1900, 2900 ] 8 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 29.2 total, 4.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 202.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.778 H:M:S, 19.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 207.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.873 H:M:S, 18.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/10-12:26:22 ... thread 0: (1000000,7000000) ops and (39743.1,129403.6) ops/second in (25.161573,54.094327) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/3 1.59 GB 56.7 7.8 0.0 7.8 14.4 6.6 0.0 2.2 115.9 213.2 69.04 62.39 126 0.548 8121K 19K 0.0 0.0 L1 7/7 809.96 MB 0.0 6.2 4.9 1.3 6.1 4.8 0.1 1.2 154.0 151.7 41.07 39.05 3 13.691 6423K 93K 0.0 0.0 L2 2/2 257.56 MB 0.0 0.1 0.1 0.0 0.1 0.1 4.1 1.8 101.6 101.5 1.10 1.06 1 1.097 113K 28 0.0 0.0 L3 30/11 1.94 GB 1.3 2.1 1.1 1.0 2.1 1.1 2.8 1.9 96.5 95.9 22.32 13.47 8 2.790 2187K 13K 0.0 0.0 L4 228/7 11.71 GB 1.2 2.1 2.0 0.1 2.1 2.0 0.8 1.0 88.4 88.4 23.96 12.89 20 1.198 2130K 436 0.0 0.0 L5 1136/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1410/30 102.59 GB 0.0 18.3 8.1 10.2 24.7 14.5 8.5 3.8 118.8 160.8 157.48 128.88 158 0.997 18M 127K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.3 8.1 10.2 24.7 14.5 8.4 3.8 118.8 160.8 157.48 128.88 158 0.997 18M 127K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.3 8.1 10.2 18.1 8.0 0.0 0.0 144.0 143.0 129.91 106.79 55 2.362 18M 127K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 244.5 27.57 22.08 103 0.268 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.4 total, 54.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.73 GB write, 465.66 MB/s write, 18.27 GB read, 344.05 MB/s read, 157.5 seconds Interval compaction: 24.73 GB write, 468.05 MB/s write, 18.27 GB read, 345.81 MB/s read, 157.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 17, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3456758 Average: 3.8525 StdDev: 41.74 Min: 1 Median: 2.0744 Max: 16345 Percentiles: P50: 2.07 P75: 3.18 P99: 9.69 P99.9: 109.04 P99.99: 152.68 ------------------------------------------------------ [ 0, 1 ] 232732 6.733% 6.733% # ( 1, 2 ] 1432371 41.437% 48.169% ######## ( 2, 3 ] 850577 24.606% 72.776% ##### ( 3, 4 ] 422742 12.229% 85.005% ## ( 4, 6 ] 381522 11.037% 96.042% ## ( 6, 10 ] 110700 3.202% 99.245% # ( 10, 15 ] 14469 0.419% 99.663% ( 15, 22 ] 5680 0.164% 99.827% ( 22, 34 ] 419 0.012% 99.840% ( 34, 51 ] 30 0.001% 99.840% ( 51, 76 ] 28 0.001% 99.841% ( 76, 110 ] 2090 0.060% 99.902% ( 110, 170 ] 4291 0.124% 100.026% ( 170, 250 ] 795 0.023% 100.049% ( 250, 380 ] 543 0.016% 100.065% ( 380, 580 ] 414 0.012% 100.077% ( 580, 870 ] 236 0.007% 100.083% ( 870, 1300 ] 94 0.003% 100.086% ( 1300, 1900 ] 51 0.001% 100.088% ( 1900, 2900 ] 77 0.002% 100.090% ( 2900, 4400 ] 152 0.004% 100.094% ( 4400, 6600 ] 55 0.002% 100.096% ( 6600, 9900 ] 18 0.001% 100.096% ( 9900, 14000 ] 2 0.000% 100.096% ( 14000, 22000 ] 1 0.000% 100.096% ** Level 1 read latency histogram (micros): Count: 1088765 Average: 9.1987 StdDev: 147.63 Min: 1 Median: 2.6768 Max: 35083 Percentiles: P50: 2.68 P75: 4.19 P99: 13.04 P99.9: 27.84 P99.99: 112.01 ------------------------------------------------------ [ 0, 1 ] 28895 2.654% 2.654% # ( 1, 2 ] 276925 25.435% 28.089% ##### ( 2, 3 ] 352462 32.373% 60.461% ###### ( 3, 4 ] 140503 12.905% 73.366% ### ( 4, 6 ] 186961 17.172% 90.538% ### ( 6, 10 ] 83086 7.631% 98.169% ## ( 10, 15 ] 14889 1.368% 99.537% ( 15, 22 ] 3738 0.343% 99.880% ( 22, 34 ] 446 0.041% 99.921% ( 34, 51 ] 73 0.007% 99.928% ( 51, 76 ] 48 0.004% 99.932% ( 76, 110 ] 598 0.055% 99.987% ( 110, 170 ] 958 0.088% 100.075% ( 170, 250 ] 244 0.022% 100.097% ( 250, 380 ] 261 0.024% 100.121% ( 380, 580 ] 293 0.027% 100.148% ( 580, 870 ] 334 0.031% 100.179% ( 870, 1300 ] 257 0.024% 100.203% ( 1300, 1900 ] 225 0.021% 100.223% ( 1900, 2900 ] 294 0.027% 100.250% ( 2900, 4400 ] 581 0.053% 100.304% ( 4400, 6600 ] 197 0.018% 100.322% ( 6600, 9900 ] 75 0.007% 100.329% ( 9900, 14000 ] 9 0.001% 100.329% ( 14000, 22000 ] 5 0.000% 100.330% ( 33000, 50000 ] 1 0.000% 100.330% ** Level 2 read latency histogram (micros): Count: 28299 Average: 10.2684 StdDev: 147.51 Min: 1 Median: 2.5729 Max: 7169 Percentiles: P50: 2.57 P75: 3.79 P99: 14.50 P99.9: 2458.42 P99.99: 6339.17 ------------------------------------------------------ [ 0, 1 ] 67 0.237% 0.237% ( 1, 2 ] 7562 26.722% 26.959% ##### ( 2, 3 ] 11382 40.221% 67.179% ######## ( 3, 4 ] 2810 9.930% 77.109% ## ( 4, 6 ] 3877 13.700% 90.809% ### ( 6, 10 ] 1964 6.940% 97.749% # ( 10, 15 ] 393 1.389% 99.138% ( 15, 22 ] 75 0.265% 99.403% ( 22, 34 ] 13 0.046% 99.449% ( 34, 51 ] 8 0.028% 99.477% ( 51, 76 ] 1 0.004% 99.481% ( 110, 170 ] 7 0.025% 99.505% ( 170, 250 ] 33 0.117% 99.622% ( 250, 380 ] 24 0.085% 99.707% ( 380, 580 ] 22 0.078% 99.784% ( 580, 870 ] 8 0.028% 99.813% ( 870, 1300 ] 11 0.039% 99.852% ( 1300, 1900 ] 7 0.025% 99.876% ( 1900, 2900 ] 12 0.042% 99.919% ( 2900, 4400 ] 14 0.049% 99.968% ( 4400, 6600 ] 7 0.025% 99.993% ( 6600, 9900 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 398366 Average: 10.7169 StdDev: 152.46 Min: 1 Median: 2.8365 Max: 9813 Percentiles: P50: 2.84 P75: 4.54 P99: 12.62 P99.9: 20.71 P99.99: 73.39 ------------------------------------------------------ [ 0, 1 ] 630 0.158% 0.158% ( 1, 2 ] 59895 15.035% 15.193% ### ( 2, 3 ] 165763 41.611% 56.804% ######## ( 3, 4 ] 51412 12.906% 69.710% ### ( 4, 6 ] 77736 19.514% 89.223% #### ( 6, 10 ] 35989 9.034% 98.258% ## ( 10, 15 ] 5645 1.417% 99.675% ( 15, 22 ] 1105 0.277% 99.952% ( 22, 34 ] 125 0.031% 99.983% ( 34, 51 ] 22 0.006% 99.989% ( 51, 76 ] 8 0.002% 99.991% ( 76, 110 ] 4 0.001% 99.992% ( 110, 170 ] 31 0.008% 100.000% ( 170, 250 ] 63 0.016% 100.016% ( 250, 380 ] 127 0.032% 100.047% ( 380, 580 ] 161 0.040% 100.088% ( 580, 870 ] 156 0.039% 100.127% ( 870, 1300 ] 165 0.041% 100.168% ( 1300, 1900 ] 125 0.031% 100.200% ( 1900, 2900 ] 162 0.041% 100.240% ( 2900, 4400 ] 268 0.067% 100.308% ( 4400, 6600 ] 89 0.022% 100.330% ( 6600, 9900 ] 33 0.008% 100.338% ** Level 4 read latency histogram (micros): Count: 17456 Average: 344.6212 StdDev: 1096.76 Min: 1 Median: 2.8491 Max: 16333 Percentiles: P50: 2.85 P75: 5.29 P99: 5463.06 P99.9: 9676.38 P99.99: 13764.85 ------------------------------------------------------ [ 0, 1 ] 105 0.602% 0.602% ( 1, 2 ] 4050 23.201% 23.803% ##### ( 2, 3 ] 5386 30.855% 54.657% ###### ( 3, 4 ] 2026 11.606% 66.264% ## ( 4, 6 ] 2372 13.588% 79.852% ### ( 6, 10 ] 632 3.621% 83.473% # ( 10, 15 ] 144 0.825% 84.298% ( 15, 22 ] 28 0.160% 84.458% ( 22, 34 ] 11 0.063% 84.521% ( 34, 51 ] 9 0.052% 84.573% ( 51, 76 ] 5 0.029% 84.601% ( 76, 110 ] 7 0.040% 84.641% ( 110, 170 ] 38 0.218% 84.859% ( 170, 250 ] 113 0.647% 85.506% ( 250, 380 ] 163 0.934% 86.440% ( 380, 580 ] 245 1.404% 87.844% ( 580, 870 ] 307 1.759% 89.602% ( 870, 1300 ] 307 1.759% 91.361% ( 1300, 1900 ] 247 1.415% 92.776% ( 1900, 2900 ] 329 1.885% 94.661% ( 2900, 4400 ] 655 3.752% 98.413% # ( 4400, 6600 ] 212 1.214% 99.628% ( 6600, 9900 ] 51 0.292% 99.920% ( 9900, 14000 ] 13 0.074% 99.994% ( 14000, 22000 ] 4 0.023% 100.017% ** Level 5 read latency histogram (micros): Count: 60 Average: 1139.6500 StdDev: 1405.99 Min: 103 Median: 455.0000 Max: 6271 Percentiles: P50: 455.00 P75: 2000.00 P99: 5940.00 P99.9: 6271.00 P99.99: 6271.00 ------------------------------------------------------ ( 76, 110 ] 2 3.333% 3.333% # ( 110, 170 ] 7 11.667% 15.000% ## ( 170, 250 ] 8 13.333% 28.333% ### ( 250, 380 ] 10 16.667% 45.000% ### ( 380, 580 ] 8 13.333% 58.333% ### ( 580, 870 ] 6 10.000% 68.333% ## ( 1300, 1900 ] 3 5.000% 73.333% # ( 1900, 2900 ] 10 16.667% 90.000% ### ( 2900, 4400 ] 4 6.667% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 54.4 total, 25.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 126.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.809 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 39.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:20.031 H:M:S, 79.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/10-12:26:27 ... thread 0: (1000000,8000000) ops and (207122.3,135771.8) ops/second in (4.828066,58.922393) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/7 2.58 GB 132.1 8.7 0.0 8.7 16.2 7.5 0.0 2.1 113.6 212.5 78.17 70.23 144 0.543 9016K 20K 0.0 0.0 L1 7/7 809.96 MB 0.0 6.2 4.9 1.3 6.1 4.8 0.1 1.2 154.0 151.7 41.07 39.05 3 13.691 6423K 93K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.1 1.8 101.6 101.5 1.10 1.06 1 1.097 113K 28 0.0 0.0 L3 16/0 982.50 MB 1.0 2.5 1.4 1.1 2.5 1.4 2.8 1.8 98.3 97.8 25.80 15.74 10 2.580 2576K 14K 0.0 0.0 L4 189/0 9.74 GB 1.0 3.5 3.2 0.2 3.5 3.2 0.8 1.1 94.4 94.3 37.52 21.52 35 1.072 3568K 3123 0.0 0.0 L5 1188/0 89.51 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1413/14 103.57 GB 0.0 20.9 9.6 11.3 28.3 17.0 11.7 3.7 116.5 158.0 183.66 147.60 193 0.952 21M 132K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.9 9.6 11.3 28.3 17.0 11.6 3.7 116.5 158.0 183.66 147.60 193 0.952 21M 132K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.9 9.6 11.3 20.8 9.4 0.0 0.0 141.0 140.2 151.69 122.24 75 2.023 21M 132K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 242.4 31.97 25.36 118 0.271 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 59.2 total, 58.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.33 GB write, 490.04 MB/s write, 20.89 GB read, 361.40 MB/s read, 183.7 seconds Interval compaction: 28.33 GB write, 492.34 MB/s write, 20.89 GB read, 363.10 MB/s read, 183.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 28, interval: 50 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3825616 Average: 3.8399 StdDev: 41.19 Min: 1 Median: 2.1192 Max: 16345 Percentiles: P50: 2.12 P75: 3.15 P99: 9.69 P99.9: 102.23 P99.99: 151.09 ------------------------------------------------------ [ 0, 1 ] 238111 6.224% 6.224% # ( 1, 2 ] 1554211 40.626% 46.851% ######## ( 2, 3 ] 1010971 26.426% 73.277% ##### ( 3, 4 ] 449634 11.753% 85.030% ## ( 4, 6 ] 419630 10.969% 95.999% ## ( 6, 10 ] 124459 3.253% 99.252% # ( 10, 15 ] 16711 0.437% 99.689% ( 15, 22 ] 5935 0.155% 99.844% ( 22, 34 ] 453 0.012% 99.856% ( 34, 51 ] 33 0.001% 99.857% ( 51, 76 ] 30 0.001% 99.858% ( 76, 110 ] 2091 0.055% 99.913% ( 110, 170 ] 4330 0.113% 100.026% ( 170, 250 ] 846 0.022% 100.048% ( 250, 380 ] 567 0.015% 100.063% ( 380, 580 ] 443 0.012% 100.074% ( 580, 870 ] 261 0.007% 100.081% ( 870, 1300 ] 105 0.003% 100.084% ( 1300, 1900 ] 62 0.002% 100.085% ( 1900, 2900 ] 86 0.002% 100.088% ( 2900, 4400 ] 169 0.004% 100.092% ( 4400, 6600 ] 59 0.002% 100.094% ( 6600, 9900 ] 18 0.000% 100.094% ( 9900, 14000 ] 2 0.000% 100.094% ( 14000, 22000 ] 1 0.000% 100.094% ** Level 1 read latency histogram (micros): Count: 1346980 Average: 8.3232 StdDev: 134.75 Min: 1 Median: 2.5947 Max: 35083 Percentiles: P50: 2.59 P75: 4.02 P99: 12.83 P99.9: 30.07 P99.99: 123.57 ------------------------------------------------------ [ 0, 1 ] 40645 3.017% 3.017% # ( 1, 2 ] 379222 28.153% 31.171% ###### ( 2, 3 ] 426452 31.660% 62.831% ###### ( 3, 4 ] 161818 12.013% 74.844% ## ( 4, 6 ] 218854 16.248% 91.092% ### ( 6, 10 ] 96623 7.173% 98.265% # ( 10, 15 ] 17496 1.299% 99.564% ( 15, 22 ] 4189 0.311% 99.875% ( 22, 34 ] 498 0.037% 99.912% ( 34, 51 ] 83 0.006% 99.918% ( 51, 76 ] 56 0.004% 99.922% ( 76, 110 ] 665 0.049% 99.972% ( 110, 170 ] 1085 0.081% 100.052% ( 170, 250 ] 311 0.023% 100.076% ( 250, 380 ] 328 0.024% 100.100% ( 380, 580 ] 367 0.027% 100.127% ( 580, 870 ] 394 0.029% 100.156% ( 870, 1300 ] 278 0.021% 100.177% ( 1300, 1900 ] 239 0.018% 100.195% ( 1900, 2900 ] 317 0.024% 100.218% ( 2900, 4400 ] 607 0.045% 100.263% ( 4400, 6600 ] 201 0.015% 100.278% ( 6600, 9900 ] 76 0.006% 100.284% ( 9900, 14000 ] 9 0.001% 100.285% ( 14000, 22000 ] 5 0.000% 100.285% ( 33000, 50000 ] 1 0.000% 100.285% ** Level 2 read latency histogram (micros): Count: 28299 Average: 10.2684 StdDev: 147.51 Min: 1 Median: 2.5729 Max: 7169 Percentiles: P50: 2.57 P75: 3.79 P99: 14.50 P99.9: 2458.42 P99.99: 6339.17 ------------------------------------------------------ [ 0, 1 ] 67 0.237% 0.237% ( 1, 2 ] 7562 26.722% 26.959% ##### ( 2, 3 ] 11382 40.221% 67.179% ######## ( 3, 4 ] 2810 9.930% 77.109% ## ( 4, 6 ] 3877 13.700% 90.809% ### ( 6, 10 ] 1964 6.940% 97.749% # ( 10, 15 ] 393 1.389% 99.138% ( 15, 22 ] 75 0.265% 99.403% ( 22, 34 ] 13 0.046% 99.449% ( 34, 51 ] 8 0.028% 99.477% ( 51, 76 ] 1 0.004% 99.481% ( 110, 170 ] 7 0.025% 99.505% ( 170, 250 ] 33 0.117% 99.622% ( 250, 380 ] 24 0.085% 99.707% ( 380, 580 ] 22 0.078% 99.784% ( 580, 870 ] 8 0.028% 99.813% ( 870, 1300 ] 11 0.039% 99.852% ( 1300, 1900 ] 7 0.025% 99.876% ( 1900, 2900 ] 12 0.042% 99.919% ( 2900, 4400 ] 14 0.049% 99.968% ( 4400, 6600 ] 7 0.025% 99.993% ( 6600, 9900 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 570393 Average: 9.4185 StdDev: 138.17 Min: 1 Median: 2.8139 Max: 9884 Percentiles: P50: 2.81 P75: 4.48 P99: 11.86 P99.9: 16.80 P99.99: 19.26 ------------------------------------------------------ [ 0, 1 ] 1031 0.181% 0.181% ( 1, 2 ] 89096 15.620% 15.801% ### ( 2, 3 ] 239671 42.019% 57.819% ######## ( 3, 4 ] 71526 12.540% 70.359% ### ( 4, 6 ] 109936 19.274% 89.633% #### ( 6, 10 ] 50607 8.872% 98.505% ## ( 10, 15 ] 7579 1.329% 99.834% ( 15, 22 ] 1464 0.257% 100.091% ( 22, 34 ] 172 0.030% 100.121% ( 34, 51 ] 28 0.005% 100.126% ( 51, 76 ] 11 0.002% 100.128% ( 76, 110 ] 4 0.001% 100.128% ( 110, 170 ] 33 0.006% 100.134% ( 170, 250 ] 66 0.012% 100.146% ( 250, 380 ] 132 0.023% 100.169% ( 380, 580 ] 166 0.029% 100.198% ( 580, 870 ] 164 0.029% 100.227% ( 870, 1300 ] 174 0.031% 100.257% ( 1300, 1900 ] 141 0.025% 100.282% ( 1900, 2900 ] 190 0.033% 100.315% ( 2900, 4400 ] 324 0.057% 100.372% ( 4400, 6600 ] 106 0.019% 100.391% ( 6600, 9900 ] 36 0.006% 100.397% ** Level 4 read latency histogram (micros): Count: 58722 Average: 127.3916 StdDev: 661.77 Min: 1 Median: 3.0867 Max: 16333 Percentiles: P50: 3.09 P75: 5.10 P99: 3861.08 P99.9: 6856.68 P99.99: 10571.08 ------------------------------------------------------ [ 0, 1 ] 222 0.378% 0.378% ( 1, 2 ] 10552 17.969% 18.347% #### ( 2, 3 ] 17859 30.413% 48.760% ###### ( 3, 4 ] 8395 14.296% 63.056% ### ( 4, 6 ] 12702 21.631% 84.687% #### ( 6, 10 ] 4332 7.377% 92.064% # ( 10, 15 ] 751 1.279% 93.343% ( 15, 22 ] 254 0.433% 93.776% ( 22, 34 ] 37 0.063% 93.839% ( 34, 51 ] 18 0.031% 93.869% ( 51, 76 ] 9 0.015% 93.885% ( 76, 110 ] 10 0.017% 93.902% ( 110, 170 ] 85 0.145% 94.047% ( 170, 250 ] 208 0.354% 94.401% ( 250, 380 ] 264 0.450% 94.850% ( 380, 580 ] 364 0.620% 95.470% ( 580, 870 ] 427 0.727% 96.197% ( 870, 1300 ] 397 0.676% 96.873% ( 1300, 1900 ] 309 0.526% 97.400% ( 1900, 2900 ] 424 0.722% 98.122% ( 2900, 4400 ] 805 1.371% 99.493% ( 4400, 6600 ] 235 0.400% 99.893% ( 6600, 9900 ] 55 0.094% 99.986% ( 9900, 14000 ] 13 0.022% 100.009% ( 14000, 22000 ] 4 0.007% 100.015% ** Level 5 read latency histogram (micros): Count: 320 Average: 1209.1906 StdDev: 1240.31 Min: 103 Median: 655.9524 Max: 6271 Percentiles: P50: 655.95 P75: 1866.67 P99: 5426.67 P99.9: 6271.00 P99.99: 6271.00 ------------------------------------------------------ ( 76, 110 ] 3 0.938% 0.938% ( 110, 170 ] 23 7.188% 8.125% # ( 170, 250 ] 30 9.375% 17.500% ## ( 250, 380 ] 50 15.625% 33.125% ### ( 380, 580 ] 43 13.438% 46.562% ### ( 580, 870 ] 42 13.125% 59.688% ### ( 870, 1300 ] 32 10.000% 69.688% ## ( 1300, 1900 ] 18 5.625% 75.312% # ( 1900, 2900 ] 39 12.188% 87.500% ## ( 2900, 4400 ] 34 10.625% 98.125% ## ( 4400, 6600 ] 6 1.875% 100.000% ** DB Stats ** Uptime(secs): 59.2 total, 4.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 132.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.491 H:M:S, 44.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 203.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.682 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 7.245 micros/op 138031 ops/sec 60.001 seconds 8281999 operations; 133.7 MB/s Microseconds per write: Count: 8281999 Average: 7.2447 StdDev: 561.00 Min: 1 Median: 2.7576 Max: 957445 Percentiles: P50: 2.76 P75: 4.24 P99: 10.88 P99.9: 1192.95 P99.99: 2775.63 ------------------------------------------------------ [ 0, 1 ] 18896 0.228% 0.228% ( 1, 2 ] 1440551 17.394% 17.622% ### ( 2, 3 ] 3539731 42.740% 60.362% ######### ( 3, 4 ] 1002605 12.106% 72.468% ## ( 4, 6 ] 1752446 21.160% 93.628% #### ( 6, 10 ] 434988 5.252% 98.880% # ( 10, 15 ] 56670 0.684% 99.564% ( 15, 22 ] 8047 0.097% 99.661% ( 22, 34 ] 2769 0.033% 99.695% ( 34, 51 ] 441 0.005% 99.700% ( 51, 76 ] 90 0.001% 99.701% ( 76, 110 ] 96 0.001% 99.702% ( 110, 170 ] 7169 0.087% 99.789% ( 170, 250 ] 823 0.010% 99.799% ( 250, 380 ] 300 0.004% 99.802% ( 380, 580 ] 46 0.001% 99.803% ( 580, 870 ] 21 0.000% 99.803% ( 870, 1300 ] 10689 0.129% 99.932% ( 1300, 1900 ] 39 0.000% 99.933% ( 1900, 2900 ] 5429 0.066% 99.998% ( 2900, 4400 ] 122 0.001% 100.000% ( 4400, 6600 ] 8 0.000% 100.000% ( 6600, 9900 ] 11 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 142732 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8281999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 8547022968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 471 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 26491288 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24678462106 rocksdb.compact.write.bytes COUNT : 24537283375 rocksdb.flush.write.bytes COUNT : 8389772544 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 68 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 133 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 8321659904 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2821120 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 24760082565 rocksdb.non.last.level.read.count COUNT : 5980482 rocksdb.block.checksum.compute.count COUNT : 5979608 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 2.019952 P95 : 5.759887 P99 : 9.614259 P100 : 957443.000000 COUNT : 8281999 SUM : 53990672 rocksdb.compaction.times.micros P50 : 1348484.848485 P95 : 6830000.000000 P99 : 22461429.000000 P100 : 22461429.000000 COUNT : 76 SUM : 152977706 rocksdb.compaction.times.cpu_micros P50 : 996000.000000 P95 : 6830000.000000 P99 : 18960000.000000 P100 : 20950936.000000 COUNT : 76 SUM : 123495195 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 770.975610 P95 : 4796.000000 P99 : 9174.000000 P100 : 24493.000000 COUNT : 122 SUM : 152819 rocksdb.compaction.outfile.sync.micros P50 : 1260.071429 P95 : 13576.333333 P99 : 33510.000000 P100 : 45382.000000 COUNT : 291 SUM : 1132732 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 162.777778 P95 : 1204.444444 P99 : 4300.000000 P100 : 8138.000000 COUNT : 220 SUM : 88427 rocksdb.table.open.io.micros P50 : 1938.888889 P95 : 8668.846154 P99 : 12412.714286 P100 : 23978.000000 COUNT : 471 SUM : 1270437 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.114037 P95 : 9.973315 P99 : 17.039915 P100 : 35095.000000 COUNT : 5978497 SUM : 56726346 rocksdb.read.block.get.micros P50 : 558.787879 P95 : 3994.776119 P99 : 6358.000000 P100 : 14195.000000 COUNT : 942 SUM : 1001126 rocksdb.write.raw.block.micros P50 : 0.589954 P95 : 1.824984 P99 : 4.316756 P100 : 37088.000000 COUNT : 7989650 SUM : 23627241 rocksdb.numfiles.in.singlecompaction P50 : 3.231343 P95 : 4.500000 P99 : 14.250000 P100 : 20.000000 COUNT : 115 SUM : 420 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563190 P95 : 1228.629927 P99 : 2635.683547 P100 : 957219.000000 COUNT : 143493 SUM : 26503103 rocksdb.sst.read.micros P50 : 2.339579 P95 : 6.834238 P99 : 11.897206 P100 : 35083.000000 COUNT : 5981081 SUM : 39967624 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8281999 SUM : 8547022968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217826.086957 P95 : 635250.000000 P99 : 1061733.333333 P100 : 1169944.000000 COUNT : 122 SUM : 32855162 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 278 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0