[2024-07-27 05:58:22.102696] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... [2024-07-27 05:58:22.102963] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid159396 ] Set seed to 1722052702096331 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-27 05:58:22.213130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-27 05:58:22.253038] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-27 05:58:22.253086] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 159396' to capture a snapshot of events at runtime. [2024-07-27 05:58:22.253103] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid159396 for offline analysis/debug. [2024-07-27 05:58:22.253129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 27 05:58:26 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/27-05:58:29 ... thread 0: (1000000,1000000) ops and (336049.8,336049.8) ops/second in (2.975749,2.975749) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.94 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 345.2 2.55 2.30 12 0.213 0 0 0.0 0.0 L1 4/0 251.74 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 254.7 254.4 0.99 0.96 1 0.989 255K 239 0.0 0.0 L2 3/2 188.87 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 255.9 255.8 0.74 0.71 1 0.738 191K 72 0.0 0.0 L3 12/0 993.26 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 103.0 308.8 4.28 3.97 14 0.306 447K 311 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.2 1.5 103.0 308.8 4.28 3.97 14 0.306 447K 311 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 255.2 255.0 1.73 1.68 2 0.864 447K 311 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 345.2 2.55 2.30 12 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.29 GB write, 413.82 MB/s write, 0.43 GB read, 137.98 MB/s read, 4.3 seconds Interval compaction: 1.29 GB write, 444.16 MB/s write, 0.43 GB read, 148.09 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 142851 Average: 1.9467 StdDev: 20.57 Min: 1 Median: 1.2447 Max: 3925 Percentiles: P50: 1.24 P75: 1.68 P99: 5.01 P99.9: 10.37 P99.99: 145.36 ------------------------------------------------------ [ 0, 1 ] 51524 36.068% 36.068% ####### ( 1, 2 ] 81325 56.930% 92.998% ########### ( 2, 3 ] 5341 3.739% 96.737% # ( 3, 4 ] 2484 1.739% 98.476% ( 4, 6 ] 1489 1.042% 99.518% ( 6, 10 ] 537 0.376% 99.894% ( 10, 15 ] 110 0.077% 99.971% ( 15, 22 ] 13 0.009% 99.980% ( 22, 34 ] 4 0.003% 99.983% ( 34, 51 ] 4 0.003% 99.986% ( 76, 110 ] 1 0.001% 99.987% ( 110, 170 ] 8 0.006% 99.992% ( 170, 250 ] 1 0.001% 99.993% ( 250, 380 ] 4 0.003% 99.996% ( 380, 580 ] 2 0.001% 99.997% ( 580, 870 ] 2 0.001% 99.999% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ( 2900, 4400 ] 4 0.003% 100.004% ** Level 1 read latency histogram (micros): Count: 20 Average: 114.3000 StdDev: 200.02 Min: 1 Median: 2.5000 Max: 646 Percentiles: P50: 2.50 P75: 170.00 P99: 646.00 P99.9: 646.00 P99.99: 646.00 ------------------------------------------------------ [ 0, 1 ] 6 30.000% 30.000% ###### ( 1, 2 ] 2 10.000% 40.000% ## ( 2, 3 ] 4 20.000% 60.000% #### ( 3, 4 ] 1 5.000% 65.000% # ( 4, 6 ] 1 5.000% 70.000% # ( 110, 170 ] 1 5.000% 75.000% # ( 170, 250 ] 1 5.000% 80.000% # ( 250, 380 ] 2 10.000% 90.000% ## ( 580, 870 ] 2 10.000% 100.000% ## ** Level 2 read latency histogram (micros): Count: 40103 Average: 2.2835 StdDev: 30.34 Min: 1 Median: 1.4157 Max: 4827 Percentiles: P50: 1.42 P75: 1.81 P99: 5.72 P99.9: 10.70 P99.99: 379.33 ------------------------------------------------------ [ 0, 1 ] 9497 23.682% 23.682% ##### ( 1, 2 ] 25390 63.312% 86.993% ############# ( 2, 3 ] 2615 6.521% 93.514% # ( 3, 4 ] 1483 3.698% 97.212% # ( 4, 6 ] 833 2.077% 99.289% ( 6, 10 ] 241 0.601% 99.890% ( 10, 15 ] 28 0.070% 99.960% ( 15, 22 ] 5 0.012% 99.973% ( 22, 34 ] 1 0.002% 99.975% ( 34, 51 ] 1 0.002% 99.978% ( 110, 170 ] 1 0.002% 99.980% ( 170, 250 ] 2 0.005% 99.985% ( 250, 380 ] 2 0.005% 99.990% ( 380, 580 ] 1 0.002% 99.993% ( 580, 870 ] 1 0.002% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1536.1273 StdDev: 1289.69 Min: 46 Median: 807.8571 Max: 4320 Percentiles: P50: 807.86 P75: 2681.25 P99: 4320.00 P99.9: 4320.00 P99.99: 4320.00 ------------------------------------------------------ ( 34, 51 ] 1 1.818% 1.818% ( 110, 170 ] 1 1.818% 3.636% ( 250, 380 ] 6 10.909% 14.545% ## ( 380, 580 ] 14 25.455% 40.000% ##### ( 580, 870 ] 7 12.727% 52.727% ### ( 870, 1300 ] 2 3.636% 56.364% # ( 1300, 1900 ] 4 7.273% 63.636% # ( 1900, 2900 ] 8 14.545% 78.182% ### ( 2900, 4400 ] 12 21.818% 100.000% #### ** Level 4 read latency histogram (micros): Count: 20 Average: 1754.2000 StdDev: 1198.95 Min: 265 Median: 1300.0000 Max: 4945 Percentiles: P50: 1300.00 P75: 2566.67 P99: 4945.00 P99.9: 4945.00 P99.99: 4945.00 ------------------------------------------------------ ( 250, 380 ] 1 5.000% 5.000% # ( 380, 580 ] 2 10.000% 15.000% ## ( 580, 870 ] 1 5.000% 20.000% # ( 870, 1300 ] 6 30.000% 50.000% ###### ( 1300, 1900 ] 3 15.000% 65.000% ### ( 1900, 2900 ] 3 15.000% 80.000% ### ( 2900, 4400 ] 3 15.000% 95.000% ### ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 307.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.441 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.441 H:M:S, 14.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-05:58:32 ... thread 0: (1000000,2000000) ops and (330897.0,333453.5) ops/second in (3.022088,5.997837) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.41 GB 12.6 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.5 327.3 7.51 6.90 28 0.268 575K 605 0.0 0.0 L1 1/1 2.49 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 254.7 254.4 0.99 0.96 1 0.989 255K 239 0.0 0.0 L2 2/1 80.00 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.3 1.5 255.9 255.8 0.74 0.71 1 0.738 191K 72 0.0 0.0 L3 17/8 868.20 MB 0.2 0.2 0.2 0.0 0.2 0.2 0.3 1.0 228.1 228.1 0.82 0.76 1 0.820 189K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 134.0 134.0 1.26 0.87 1 1.256 170K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/22 97.98 GB 0.0 1.3 0.7 0.6 3.2 2.6 1.4 1.7 120.5 287.6 11.31 10.20 32 0.353 1384K 916 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.7 0.6 3.2 2.6 1.3 1.7 120.5 287.6 11.31 10.20 32 0.353 1384K 916 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 0.0 230.1 230.0 5.92 5.38 6 0.987 1384K 916 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.0 5.38 4.82 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.18 GB write, 523.00 MB/s write, 1.33 GB read, 219.23 MB/s read, 11.3 seconds Interval compaction: 3.18 GB write, 542.03 MB/s write, 1.33 GB read, 227.21 MB/s read, 11.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 362287 Average: 2.1480 StdDev: 16.98 Min: 1 Median: 1.4128 Max: 3925 Percentiles: P50: 1.41 P75: 1.82 P99: 5.68 P99.9: 9.98 P99.99: 20.25 ------------------------------------------------------ [ 0, 1 ] 88612 24.459% 24.459% ##### ( 1, 2 ] 224153 61.872% 86.331% ############ ( 2, 3 ] 26443 7.299% 93.630% # ( 3, 4 ] 12266 3.386% 97.015% # ( 4, 6 ] 8568 2.365% 99.380% ( 6, 10 ] 1893 0.523% 99.903% ( 10, 15 ] 290 0.080% 99.983% ( 15, 22 ] 37 0.010% 99.993% ( 22, 34 ] 9 0.002% 99.996% ( 34, 51 ] 9 0.002% 99.998% ( 51, 76 ] 1 0.000% 99.998% ( 76, 110 ] 1 0.000% 99.999% ( 110, 170 ] 16 0.004% 100.003% ( 170, 250 ] 5 0.001% 100.004% ( 250, 380 ] 9 0.002% 100.007% ( 380, 580 ] 3 0.001% 100.008% ( 580, 870 ] 6 0.002% 100.009% ( 870, 1300 ] 6 0.002% 100.011% ( 1300, 1900 ] 2 0.001% 100.012% ( 1900, 2900 ] 3 0.001% 100.012% ( 2900, 4400 ] 6 0.002% 100.014% ** Level 1 read latency histogram (micros): Count: 21 Average: 108.9524 StdDev: 196.66 Min: 1 Median: 2.3750 Max: 646 Percentiles: P50: 2.38 P75: 155.00 P99: 646.00 P99.9: 646.00 P99.99: 646.00 ------------------------------------------------------ [ 0, 1 ] 6 28.571% 28.571% ###### ( 1, 2 ] 3 14.286% 42.857% ### ( 2, 3 ] 4 19.048% 61.905% #### ( 3, 4 ] 1 4.762% 66.667% # ( 4, 6 ] 1 4.762% 71.429% # ( 110, 170 ] 1 4.762% 76.190% # ( 170, 250 ] 1 4.762% 80.952% # ( 250, 380 ] 2 9.524% 90.476% ## ( 580, 870 ] 2 9.524% 100.000% ## ** Level 2 read latency histogram (micros): Count: 63460 Average: 2.4619 StdDev: 25.11 Min: 1 Median: 1.4752 Max: 4827 Percentiles: P50: 1.48 P75: 1.86 P99: 6.52 P99.9: 86.59 P99.99: 501.80 ------------------------------------------------------ [ 0, 1 ] 12312 19.401% 19.401% #### ( 1, 2 ] 40864 64.393% 83.795% ############# ( 2, 3 ] 5375 8.470% 92.264% ## ( 3, 4 ] 2607 4.108% 96.373% # ( 4, 6 ] 1593 2.510% 98.883% # ( 6, 10 ] 568 0.895% 99.778% ( 10, 15 ] 57 0.090% 99.868% ( 15, 22 ] 9 0.014% 99.882% ( 22, 34 ] 1 0.002% 99.883% ( 34, 51 ] 1 0.002% 99.885% ( 51, 76 ] 3 0.005% 99.890% ( 76, 110 ] 21 0.033% 99.923% ( 110, 170 ] 24 0.038% 99.961% ( 170, 250 ] 8 0.013% 99.973% ( 250, 380 ] 7 0.011% 99.984% ( 380, 580 ] 6 0.009% 99.994% ( 580, 870 ] 2 0.003% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 186665 Average: 3.3643 StdDev: 38.13 Min: 1 Median: 1.5921 Max: 4320 Percentiles: P50: 1.59 P75: 2.00 P99: 9.14 P99.9: 169.40 P99.99: 551.63 ------------------------------------------------------ [ 0, 1 ] 25651 13.742% 13.742% ### ( 1, 2 ] 114298 61.232% 74.973% ############ ( 2, 3 ] 27315 14.633% 89.607% ### ( 3, 4 ] 8060 4.318% 93.924% # ( 4, 6 ] 7117 3.813% 97.737% # ( 6, 10 ] 3001 1.608% 99.345% ( 10, 15 ] 586 0.314% 99.659% ( 15, 22 ] 115 0.062% 99.720% ( 22, 34 ] 16 0.009% 99.729% ( 34, 51 ] 5 0.003% 99.732% ( 51, 76 ] 8 0.004% 99.736% ( 76, 110 ] 142 0.076% 99.812% ( 110, 170 ] 166 0.089% 99.901% ( 170, 250 ] 66 0.035% 99.936% ( 250, 380 ] 60 0.032% 99.968% ( 380, 580 ] 47 0.025% 99.994% ( 580, 870 ] 22 0.012% 100.005% ( 870, 1300 ] 4 0.002% 100.008% ( 1300, 1900 ] 8 0.004% 100.012% ( 1900, 2900 ] 9 0.005% 100.017% ( 2900, 4400 ] 13 0.007% 100.024% ** Level 4 read latency histogram (micros): Count: 310 Average: 117.6548 StdDev: 527.03 Min: 0 Median: 1.7921 Max: 4945 Percentiles: P50: 1.79 P75: 4.10 P99: 3350.00 P99.9: 4945.00 P99.99: 4945.00 ------------------------------------------------------ [ 0, 1 ] 75 24.194% 24.194% ##### ( 1, 2 ] 101 32.581% 56.774% ####### ( 2, 3 ] 46 14.839% 71.613% ### ( 3, 4 ] 10 3.226% 74.839% # ( 4, 6 ] 10 3.226% 78.065% # ( 6, 10 ] 30 9.677% 87.742% ## ( 10, 15 ] 13 4.194% 91.935% # ( 15, 22 ] 2 0.645% 92.581% ( 22, 34 ] 1 0.323% 92.903% ( 76, 110 ] 1 0.323% 93.226% ( 250, 380 ] 2 0.645% 93.871% ( 380, 580 ] 2 0.645% 94.516% ( 580, 870 ] 1 0.323% 94.839% ( 870, 1300 ] 6 1.935% 96.774% ( 1300, 1900 ] 3 0.968% 97.742% ( 1900, 2900 ] 3 0.968% 98.710% ( 2900, 4400 ] 3 0.968% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 634.8500 StdDev: 717.19 Min: 85 Median: 170.0000 Max: 2158 Percentiles: P50: 170.00 P75: 1085.00 P99: 2158.00 P99.9: 2158.00 P99.99: 2158.00 ------------------------------------------------------ ( 76, 110 ] 7 35.000% 35.000% ####### ( 110, 170 ] 3 15.000% 50.000% ### ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 1 5.000% 65.000% # ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.895 H:M:S, 14.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.453 H:M:S, 15.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/27-05:58:35 ... thread 0: (1000000,3000000) ops and (331120.0,332672.1) ops/second in (3.020053,9.017890) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 1.4 0.0 1.4 4.2 2.8 0.0 1.5 107.5 317.7 13.48 12.51 44 0.306 1471K 1556 0.0 0.0 L1 10/0 1005.35 MB 100.5 1.2 1.2 0.0 1.2 1.2 0.2 1.0 240.7 239.8 5.24 5.11 2 2.621 1281K 4485 0.0 0.0 L2 1/0 78.16 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.3 1.5 255.9 255.8 0.74 0.71 1 0.738 191K 72 0.0 0.0 L3 15/0 868.82 MB 0.9 0.8 0.2 0.7 0.8 0.2 0.3 4.6 231.1 230.8 3.75 3.50 2 1.876 880K 1240 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 134.0 134.0 1.26 0.87 1 1.256 170K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/4 98.90 GB 0.0 3.8 1.7 2.1 6.6 4.5 1.4 2.4 160.8 276.4 24.47 22.71 50 0.489 3995K 7353 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 1.7 2.1 6.6 4.5 1.3 2.4 160.8 276.4 24.47 22.71 50 0.489 3995K 7353 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 1.7 2.1 3.8 1.7 0.0 0.0 239.7 239.2 16.42 15.52 11 1.493 3995K 7353 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.3 8.05 7.18 39 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.60 GB write, 732.00 MB/s write, 3.84 GB read, 425.96 MB/s read, 24.5 seconds Interval compaction: 6.60 GB write, 749.71 MB/s write, 3.84 GB read, 436.27 MB/s read, 24.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 10, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 796001 Average: 2.1688 StdDev: 12.87 Min: 1 Median: 1.4642 Max: 3925 Percentiles: P50: 1.46 P75: 1.85 P99: 5.60 P99.9: 9.57 P99.99: 13.30 ------------------------------------------------------ [ 0, 1 ] 157503 19.787% 19.787% #### ( 1, 2 ] 518038 65.080% 84.867% ############# ( 2, 3 ] 66965 8.413% 93.280% ## ( 3, 4 ] 29703 3.732% 97.011% # ( 4, 6 ] 19791 2.486% 99.497% ( 6, 10 ] 3592 0.451% 99.949% ( 10, 15 ] 500 0.063% 100.011% ( 15, 22 ] 65 0.008% 100.020% ( 22, 34 ] 18 0.002% 100.022% ( 34, 51 ] 13 0.002% 100.023% ( 51, 76 ] 1 0.000% 100.024% ( 76, 110 ] 8 0.001% 100.025% ( 110, 170 ] 31 0.004% 100.029% ( 170, 250 ] 16 0.002% 100.031% ( 250, 380 ] 16 0.002% 100.033% ( 380, 580 ] 7 0.001% 100.033% ( 580, 870 ] 11 0.001% 100.035% ( 870, 1300 ] 11 0.001% 100.036% ( 1300, 1900 ] 6 0.001% 100.037% ( 1900, 2900 ] 4 0.001% 100.037% ( 2900, 4400 ] 6 0.001% 100.038% ** Level 1 read latency histogram (micros): Count: 701 Average: 28.5036 StdDev: 155.63 Min: 0 Median: 1.5157 Max: 1977 Percentiles: P50: 1.52 P75: 1.97 P99: 868.55 P99.9: 1977.00 P99.99: 1977.00 ------------------------------------------------------ [ 0, 1 ] 153 21.826% 21.826% #### ( 1, 2 ] 383 54.636% 76.462% ########### ( 2, 3 ] 92 13.124% 89.586% ### ( 3, 4 ] 18 2.568% 92.154% # ( 4, 6 ] 10 1.427% 93.581% ( 6, 10 ] 5 0.713% 94.294% ( 10, 15 ] 2 0.285% 94.579% ( 34, 51 ] 1 0.143% 94.722% ( 110, 170 ] 12 1.712% 96.434% ( 170, 250 ] 2 0.285% 96.719% ( 250, 380 ] 9 1.284% 98.003% ( 380, 580 ] 5 0.713% 98.716% ( 580, 870 ] 2 0.285% 99.001% ( 870, 1300 ] 5 0.713% 99.715% ( 1300, 1900 ] 1 0.143% 99.857% ( 1900, 2900 ] 1 0.143% 100.000% ** Level 2 read latency histogram (micros): Count: 76248 Average: 2.4624 StdDev: 22.98 Min: 1 Median: 1.4984 Max: 4827 Percentiles: P50: 1.50 P75: 1.89 P99: 7.11 P99.9: 31.02 P99.99: 476.43 ------------------------------------------------------ [ 0, 1 ] 13599 17.835% 17.835% #### ( 1, 2 ] 49206 64.534% 82.369% ############# ( 2, 3 ] 7003 9.185% 91.554% ## ( 3, 4 ] 3349 4.392% 95.946% # ( 4, 6 ] 2105 2.761% 98.707% # ( 6, 10 ] 806 1.057% 99.764% ( 10, 15 ] 92 0.121% 99.885% ( 15, 22 ] 11 0.014% 99.899% ( 22, 34 ] 1 0.001% 99.900% ( 34, 51 ] 1 0.001% 99.902% ( 51, 76 ] 3 0.004% 99.906% ( 76, 110 ] 22 0.029% 99.934% ( 110, 170 ] 24 0.031% 99.966% ( 170, 250 ] 8 0.010% 99.976% ( 250, 380 ] 7 0.009% 99.986% ( 380, 580 ] 7 0.009% 99.995% ( 580, 870 ] 2 0.003% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 186695 Average: 3.4154 StdDev: 38.95 Min: 1 Median: 1.5922 Max: 4320 Percentiles: P50: 1.59 P75: 2.00 P99: 9.16 P99.9: 181.28 P99.99: 577.21 ------------------------------------------------------ [ 0, 1 ] 25660 13.744% 13.744% ### ( 1, 2 ] 114304 61.225% 74.969% ############ ( 2, 3 ] 27318 14.632% 89.602% ### ( 3, 4 ] 8060 4.317% 93.919% # ( 4, 6 ] 7117 3.812% 97.731% # ( 6, 10 ] 3001 1.607% 99.338% ( 10, 15 ] 586 0.314% 99.652% ( 15, 22 ] 115 0.062% 99.714% ( 22, 34 ] 16 0.009% 99.723% ( 34, 51 ] 5 0.003% 99.725% ( 51, 76 ] 8 0.004% 99.730% ( 76, 110 ] 142 0.076% 99.806% ( 110, 170 ] 167 0.089% 99.895% ( 170, 250 ] 66 0.035% 99.930% ( 250, 380 ] 64 0.034% 99.965% ( 380, 580 ] 48 0.026% 99.990% ( 580, 870 ] 22 0.012% 100.002% ( 870, 1300 ] 8 0.004% 100.006% ( 1300, 1900 ] 9 0.005% 100.011% ( 1900, 2900 ] 10 0.005% 100.017% ( 2900, 4400 ] 13 0.007% 100.024% ** Level 4 read latency histogram (micros): Count: 310 Average: 117.6548 StdDev: 527.03 Min: 0 Median: 1.7921 Max: 4945 Percentiles: P50: 1.79 P75: 4.10 P99: 3350.00 P99.9: 4945.00 P99.99: 4945.00 ------------------------------------------------------ [ 0, 1 ] 75 24.194% 24.194% ##### ( 1, 2 ] 101 32.581% 56.774% ####### ( 2, 3 ] 46 14.839% 71.613% ### ( 3, 4 ] 10 3.226% 74.839% # ( 4, 6 ] 10 3.226% 78.065% # ( 6, 10 ] 30 9.677% 87.742% ## ( 10, 15 ] 13 4.194% 91.935% # ( 15, 22 ] 2 0.645% 92.581% ( 22, 34 ] 1 0.323% 92.903% ( 76, 110 ] 1 0.323% 93.226% ( 250, 380 ] 2 0.645% 93.871% ( 380, 580 ] 2 0.645% 94.516% ( 580, 870 ] 1 0.323% 94.839% ( 870, 1300 ] 6 1.935% 96.774% ( 1300, 1900 ] 3 0.968% 97.742% ( 1900, 2900 ] 3 0.968% 98.710% ( 2900, 4400 ] 3 0.968% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 634.8500 StdDev: 717.19 Min: 85 Median: 170.0000 Max: 2158 Percentiles: P50: 170.00 P75: 1085.00 P99: 2158.00 P99.9: 2158.00 P99.99: 2158.00 ------------------------------------------------------ ( 76, 110 ] 7 35.000% 35.000% ####### ( 110, 170 ] 3 15.000% 50.000% ### ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 1 5.000% 65.000% # ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 319.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.336 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.442 H:M:S, 14.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/27-05:58:38 ... thread 0: (1000000,4000000) ops and (336992.3,333741.7) ops/second in (2.967427,11.985317) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.34 GB 12.6 2.2 0.0 2.2 6.0 3.8 0.0 1.6 117.2 315.6 19.36 18.03 61 0.317 2302K 2399 0.0 0.0 L1 6/6 492.08 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 240.7 239.8 5.24 5.11 2 2.621 1281K 4485 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.8 1.5 255.9 255.8 0.74 0.71 1 0.738 191K 72 0.0 0.0 L3 21/0 943.69 MB 0.9 1.6 0.8 0.8 1.6 0.8 0.3 2.1 224.8 224.4 7.15 6.60 4 1.786 1631K 2653 0.0 0.0 L4 170/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 134.0 134.0 1.26 0.87 1 1.256 170K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/20 99.88 GB 0.0 5.4 2.3 3.1 9.1 6.0 3.1 2.4 162.8 276.4 33.74 31.32 69 0.489 5577K 9609 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.3 3.1 9.1 6.0 3.0 2.4 162.8 276.4 33.74 31.32 69 0.489 5577K 9609 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.3 3.1 5.4 2.3 0.0 0.0 239.9 239.4 22.90 21.65 16 1.431 5577K 9609 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.6 10.84 9.68 53 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.11 GB write, 764.07 MB/s write, 5.36 GB read, 450.05 MB/s read, 33.7 seconds Interval compaction: 9.11 GB write, 777.98 MB/s write, 5.36 GB read, 458.24 MB/s read, 33.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 14, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1040622 Average: 2.1881 StdDev: 12.16 Min: 0 Median: 1.4756 Max: 3925 Percentiles: P50: 1.48 P75: 1.86 P99: 5.61 P99.9: 9.65 P99.99: 13.80 ------------------------------------------------------ [ 0, 1 ] 195501 18.787% 18.787% #### ( 1, 2 ] 683000 65.634% 84.421% ############# ( 2, 3 ] 90343 8.682% 93.102% ## ( 3, 4 ] 40018 3.846% 96.948% # ( 4, 6 ] 26513 2.548% 99.496% # ( 6, 10 ] 4617 0.444% 99.939% ( 10, 15 ] 694 0.067% 100.006% ( 15, 22 ] 77 0.007% 100.014% ( 22, 34 ] 19 0.002% 100.015% ( 34, 51 ] 16 0.002% 100.017% ( 51, 76 ] 3 0.000% 100.017% ( 76, 110 ] 13 0.001% 100.018% ( 110, 170 ] 49 0.005% 100.023% ( 170, 250 ] 27 0.003% 100.026% ( 250, 380 ] 26 0.002% 100.028% ( 380, 580 ] 13 0.001% 100.030% ( 580, 870 ] 22 0.002% 100.032% ( 870, 1300 ] 15 0.001% 100.033% ( 1300, 1900 ] 6 0.001% 100.034% ( 1900, 2900 ] 4 0.000% 100.034% ( 2900, 4400 ] 7 0.001% 100.035% ** Level 1 read latency histogram (micros): Count: 183499 Average: 2.5994 StdDev: 16.30 Min: 0 Median: 1.5604 Max: 3199 Percentiles: P50: 1.56 P75: 1.92 P99: 6.29 P99.9: 81.20 P99.99: 386.19 ------------------------------------------------------ [ 0, 1 ] 20997 11.443% 11.443% ## ( 1, 2 ] 126254 68.804% 80.246% ############## ( 2, 3 ] 20737 11.301% 91.547% ## ( 3, 4 ] 7848 4.277% 95.824% # ( 4, 6 ] 5718 3.116% 98.940% # ( 6, 10 ] 1500 0.817% 99.757% ( 10, 15 ] 232 0.126% 99.884% ( 15, 22 ] 21 0.011% 99.895% ( 22, 34 ] 2 0.001% 99.896% ( 34, 51 ] 1 0.001% 99.897% ( 76, 110 ] 36 0.020% 99.917% ( 110, 170 ] 66 0.036% 99.953% ( 170, 250 ] 35 0.019% 99.972% ( 250, 380 ] 33 0.018% 99.990% ( 380, 580 ] 21 0.011% 100.001% ( 580, 870 ] 12 0.007% 100.008% ( 870, 1300 ] 6 0.003% 100.011% ( 1300, 1900 ] 1 0.001% 100.011% ( 1900, 2900 ] 3 0.002% 100.013% ( 2900, 4400 ] 1 0.001% 100.014% ** Level 2 read latency histogram (micros): Count: 76248 Average: 2.4624 StdDev: 22.98 Min: 1 Median: 1.4984 Max: 4827 Percentiles: P50: 1.50 P75: 1.89 P99: 7.11 P99.9: 31.02 P99.99: 476.43 ------------------------------------------------------ [ 0, 1 ] 13599 17.835% 17.835% #### ( 1, 2 ] 49206 64.534% 82.369% ############# ( 2, 3 ] 7003 9.185% 91.554% ## ( 3, 4 ] 3349 4.392% 95.946% # ( 4, 6 ] 2105 2.761% 98.707% # ( 6, 10 ] 806 1.057% 99.764% ( 10, 15 ] 92 0.121% 99.885% ( 15, 22 ] 11 0.014% 99.899% ( 22, 34 ] 1 0.001% 99.900% ( 34, 51 ] 1 0.001% 99.902% ( 51, 76 ] 3 0.004% 99.906% ( 76, 110 ] 22 0.029% 99.934% ( 110, 170 ] 24 0.031% 99.966% ( 170, 250 ] 8 0.010% 99.976% ( 250, 380 ] 7 0.009% 99.986% ( 380, 580 ] 7 0.009% 99.995% ( 580, 870 ] 2 0.003% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 191562 Average: 3.9711 StdDev: 41.23 Min: 0 Median: 1.5932 Max: 4320 Percentiles: P50: 1.59 P75: 2.01 P99: 9.75 P99.9: 334.70 P99.99: 751.54 ------------------------------------------------------ [ 0, 1 ] 26269 13.713% 13.713% ### ( 1, 2 ] 117176 61.169% 74.882% ############ ( 2, 3 ] 27733 14.477% 89.359% ### ( 3, 4 ] 8325 4.346% 93.705% # ( 4, 6 ] 7249 3.784% 97.489% # ( 6, 10 ] 3085 1.610% 99.100% ( 10, 15 ] 600 0.313% 99.413% ( 15, 22 ] 116 0.061% 99.473% ( 22, 34 ] 16 0.008% 99.482% ( 34, 51 ] 5 0.003% 99.484% ( 51, 76 ] 12 0.006% 99.491% ( 76, 110 ] 223 0.116% 99.607% ( 110, 170 ] 333 0.174% 99.781% ( 170, 250 ] 147 0.077% 99.857% ( 250, 380 ] 125 0.065% 99.923% ( 380, 580 ] 104 0.054% 99.977% ( 580, 870 ] 42 0.022% 99.999% ( 870, 1300 ] 13 0.007% 100.006% ( 1300, 1900 ] 10 0.005% 100.011% ( 1900, 2900 ] 10 0.005% 100.016% ( 2900, 4400 ] 13 0.007% 100.023% ** Level 4 read latency histogram (micros): Count: 310 Average: 117.6548 StdDev: 527.03 Min: 0 Median: 1.7921 Max: 4945 Percentiles: P50: 1.79 P75: 4.10 P99: 3350.00 P99.9: 4945.00 P99.99: 4945.00 ------------------------------------------------------ [ 0, 1 ] 75 24.194% 24.194% ##### ( 1, 2 ] 101 32.581% 56.774% ####### ( 2, 3 ] 46 14.839% 71.613% ### ( 3, 4 ] 10 3.226% 74.839% # ( 4, 6 ] 10 3.226% 78.065% # ( 6, 10 ] 30 9.677% 87.742% ## ( 10, 15 ] 13 4.194% 91.935% # ( 15, 22 ] 2 0.645% 92.581% ( 22, 34 ] 1 0.323% 92.903% ( 76, 110 ] 1 0.323% 93.226% ( 250, 380 ] 2 0.645% 93.871% ( 380, 580 ] 2 0.645% 94.516% ( 580, 870 ] 1 0.323% 94.839% ( 870, 1300 ] 6 1.935% 96.774% ( 1300, 1900 ] 3 0.968% 97.742% ( 1900, 2900 ] 3 0.968% 98.710% ( 2900, 4400 ] 3 0.968% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 812.6167 StdDev: 957.51 Min: 85 Median: 405.0000 Max: 3912 Percentiles: P50: 405.00 P75: 1085.00 P99: 3912.00 P99.9: 3912.00 P99.99: 3912.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 12 20.000% 40.000% #### ( 170, 250 ] 2 3.333% 43.333% # ( 250, 380 ] 3 5.000% 48.333% # ( 380, 580 ] 8 13.333% 61.667% ### ( 580, 870 ] 6 10.000% 71.667% ## ( 870, 1300 ] 4 6.667% 78.333% # ( 1300, 1900 ] 3 5.000% 83.333% # ( 1900, 2900 ] 7 11.667% 95.000% ## ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 322.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.734 H:M:S, 14.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-05:58:41 ... thread 0: (1000000,5000000) ops and (289461.2,323834.0) ops/second in (3.454694,15.440011) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.32 GB 138.5 3.3 0.0 3.3 8.0 4.7 0.0 1.7 128.2 314.2 26.05 24.36 80 0.326 3390K 3497 0.0 0.0 L1 6/6 492.08 MB 0.0 1.2 1.2 0.0 1.2 1.2 0.2 1.0 240.7 239.8 5.24 5.11 2 2.621 1281K 4485 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.8 1.5 255.9 255.8 0.74 0.71 1 0.738 191K 72 0.0 0.0 L3 21/0 943.69 MB 0.9 1.6 0.8 0.8 1.6 0.8 0.3 2.1 224.8 224.4 7.15 6.60 4 1.786 1631K 2653 0.0 0.0 L4 170/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 134.0 134.0 1.26 0.87 1 1.256 170K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1267/16 100.86 GB 0.0 6.4 2.3 4.1 11.1 7.0 3.1 2.4 162.3 282.0 40.43 37.65 88 0.459 6665K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 2.3 4.1 11.1 7.0 3.0 2.4 162.3 282.0 40.43 37.65 88 0.459 6665K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 2.3 4.1 6.4 2.3 0.0 0.0 244.9 244.5 26.80 25.48 20 1.340 6665K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.8 13.64 12.17 68 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.7 total, 15.4 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.14 GB write, 728.19 MB/s write, 6.41 GB read, 419.15 MB/s read, 40.4 seconds Interval compaction: 11.14 GB write, 738.49 MB/s write, 6.41 GB read, 425.08 MB/s read, 40.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 15, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1480373 Average: 2.1851 StdDev: 11.93 Min: 0 Median: 1.4759 Max: 4762 Percentiles: P50: 1.48 P75: 1.85 P99: 5.62 P99.9: 9.67 P99.99: 13.71 ------------------------------------------------------ [ 0, 1 ] 273121 18.449% 18.449% #### ( 1, 2 ] 981367 66.292% 84.741% ############# ( 2, 3 ] 126808 8.566% 93.307% ## ( 3, 4 ] 55505 3.749% 97.057% # ( 4, 6 ] 35456 2.395% 99.452% ( 6, 10 ] 7240 0.489% 99.941% ( 10, 15 ] 982 0.066% 100.007% ( 15, 22 ] 113 0.008% 100.015% ( 22, 34 ] 25 0.002% 100.016% ( 34, 51 ] 21 0.001% 100.018% ( 51, 76 ] 6 0.000% 100.018% ( 76, 110 ] 52 0.004% 100.022% ( 110, 170 ] 76 0.005% 100.027% ( 170, 250 ] 38 0.003% 100.030% ( 250, 380 ] 39 0.003% 100.032% ( 380, 580 ] 17 0.001% 100.033% ( 580, 870 ] 32 0.002% 100.035% ( 870, 1300 ] 20 0.001% 100.037% ( 1300, 1900 ] 8 0.001% 100.037% ( 1900, 2900 ] 5 0.000% 100.038% ( 2900, 4400 ] 8 0.001% 100.038% ( 4400, 6600 ] 1 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 185897 Average: 2.6275 StdDev: 16.38 Min: 0 Median: 1.5569 Max: 3199 Percentiles: P50: 1.56 P75: 1.92 P99: 6.48 P99.9: 102.35 P99.99: 400.96 ------------------------------------------------------ [ 0, 1 ] 21884 11.772% 11.772% ## ( 1, 2 ] 127597 68.639% 80.411% ############## ( 2, 3 ] 20775 11.176% 91.586% ## ( 3, 4 ] 7867 4.232% 95.818% # ( 4, 6 ] 5730 3.082% 98.900% # ( 6, 10 ] 1532 0.824% 99.725% ( 10, 15 ] 234 0.126% 99.850% ( 15, 22 ] 23 0.012% 99.863% ( 22, 34 ] 2 0.001% 99.864% ( 34, 51 ] 1 0.001% 99.864% ( 51, 76 ] 1 0.001% 99.865% ( 76, 110 ] 84 0.045% 99.910% ( 110, 170 ] 75 0.040% 99.951% ( 170, 250 ] 37 0.020% 99.970% ( 250, 380 ] 34 0.018% 99.989% ( 380, 580 ] 23 0.012% 100.001% ( 580, 870 ] 12 0.006% 100.008% ( 870, 1300 ] 6 0.003% 100.011% ( 1300, 1900 ] 1 0.001% 100.011% ( 1900, 2900 ] 3 0.002% 100.013% ( 2900, 4400 ] 1 0.001% 100.013% ** Level 2 read latency histogram (micros): Count: 76248 Average: 2.4624 StdDev: 22.98 Min: 1 Median: 1.4984 Max: 4827 Percentiles: P50: 1.50 P75: 1.89 P99: 7.11 P99.9: 31.02 P99.99: 476.43 ------------------------------------------------------ [ 0, 1 ] 13599 17.835% 17.835% #### ( 1, 2 ] 49206 64.534% 82.369% ############# ( 2, 3 ] 7003 9.185% 91.554% ## ( 3, 4 ] 3349 4.392% 95.946% # ( 4, 6 ] 2105 2.761% 98.707% # ( 6, 10 ] 806 1.057% 99.764% ( 10, 15 ] 92 0.121% 99.885% ( 15, 22 ] 11 0.014% 99.899% ( 22, 34 ] 1 0.001% 99.900% ( 34, 51 ] 1 0.001% 99.902% ( 51, 76 ] 3 0.004% 99.906% ( 76, 110 ] 22 0.029% 99.934% ( 110, 170 ] 24 0.031% 99.966% ( 170, 250 ] 8 0.010% 99.976% ( 250, 380 ] 7 0.009% 99.986% ( 380, 580 ] 7 0.009% 99.995% ( 580, 870 ] 2 0.003% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 191562 Average: 3.9711 StdDev: 41.23 Min: 0 Median: 1.5932 Max: 4320 Percentiles: P50: 1.59 P75: 2.01 P99: 9.75 P99.9: 334.70 P99.99: 751.54 ------------------------------------------------------ [ 0, 1 ] 26269 13.713% 13.713% ### ( 1, 2 ] 117176 61.169% 74.882% ############ ( 2, 3 ] 27733 14.477% 89.359% ### ( 3, 4 ] 8325 4.346% 93.705% # ( 4, 6 ] 7249 3.784% 97.489% # ( 6, 10 ] 3085 1.610% 99.100% ( 10, 15 ] 600 0.313% 99.413% ( 15, 22 ] 116 0.061% 99.473% ( 22, 34 ] 16 0.008% 99.482% ( 34, 51 ] 5 0.003% 99.484% ( 51, 76 ] 12 0.006% 99.491% ( 76, 110 ] 223 0.116% 99.607% ( 110, 170 ] 333 0.174% 99.781% ( 170, 250 ] 147 0.077% 99.857% ( 250, 380 ] 125 0.065% 99.923% ( 380, 580 ] 104 0.054% 99.977% ( 580, 870 ] 42 0.022% 99.999% ( 870, 1300 ] 13 0.007% 100.006% ( 1300, 1900 ] 10 0.005% 100.011% ( 1900, 2900 ] 10 0.005% 100.016% ( 2900, 4400 ] 13 0.007% 100.023% ** Level 4 read latency histogram (micros): Count: 310 Average: 117.6548 StdDev: 527.03 Min: 0 Median: 1.7921 Max: 4945 Percentiles: P50: 1.79 P75: 4.10 P99: 3350.00 P99.9: 4945.00 P99.99: 4945.00 ------------------------------------------------------ [ 0, 1 ] 75 24.194% 24.194% ##### ( 1, 2 ] 101 32.581% 56.774% ####### ( 2, 3 ] 46 14.839% 71.613% ### ( 3, 4 ] 10 3.226% 74.839% # ( 4, 6 ] 10 3.226% 78.065% # ( 6, 10 ] 30 9.677% 87.742% ## ( 10, 15 ] 13 4.194% 91.935% # ( 15, 22 ] 2 0.645% 92.581% ( 22, 34 ] 1 0.323% 92.903% ( 76, 110 ] 1 0.323% 93.226% ( 250, 380 ] 2 0.645% 93.871% ( 380, 580 ] 2 0.645% 94.516% ( 580, 870 ] 1 0.323% 94.839% ( 870, 1300 ] 6 1.935% 96.774% ( 1300, 1900 ] 3 0.968% 97.742% ( 1900, 2900 ] 3 0.968% 98.710% ( 2900, 4400 ] 3 0.968% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 812.6167 StdDev: 957.51 Min: 85 Median: 405.0000 Max: 3912 Percentiles: P50: 405.00 P75: 1085.00 P99: 3912.00 P99.9: 3912.00 P99.99: 3912.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 12 20.000% 40.000% #### ( 170, 250 ] 2 3.333% 43.333% # ( 250, 380 ] 3 5.000% 48.333% # ( 380, 580 ] 8 13.333% 61.667% ### ( 580, 870 ] 6 10.000% 71.667% ## ( 870, 1300 ] 4 6.667% 78.333% # ( 1300, 1900 ] 3 5.000% 83.333% # ( 1900, 2900 ] 7 11.667% 95.000% ## ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.7 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.635 H:M:S, 16.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.901 H:M:S, 26.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/27-05:58:49 ... thread 0: (1000000,6000000) ops and (142288.3,267046.5) ops/second in (7.027986,22.467997) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.27 GB 18.9 4.8 0.0 4.8 10.5 5.7 0.0 1.8 142.7 310.7 34.44 32.32 99 0.348 4988K 6657 0.0 0.0 L1 12/12 1.42 GB 0.0 3.7 3.2 0.5 3.6 3.2 0.2 1.1 233.7 231.6 16.13 15.62 3 5.375 3826K 32K 0.0 0.0 L2 8/4 1020.45 MB 5.1 0.2 0.1 0.1 0.2 0.1 1.8 1.5 255.9 255.8 0.74 0.71 1 0.738 191K 72 0.0 0.0 L3 21/9 943.69 MB 0.4 1.6 0.8 0.8 1.6 0.8 0.3 2.1 224.8 224.4 7.15 6.60 4 1.786 1631K 2653 0.0 0.0 L4 170/0 9.59 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 134.0 134.0 1.26 0.87 1 1.256 170K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/33 101.75 GB 0.0 10.4 4.2 6.1 16.0 9.9 4.1 2.8 178.3 274.6 59.70 56.12 108 0.553 10M 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.4 4.2 6.1 16.0 9.9 3.9 2.8 178.3 274.6 59.70 56.12 108 0.553 10M 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.4 4.2 6.1 10.4 4.2 0.0 0.0 245.5 244.5 43.36 41.56 25 1.734 10M 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.6 16.34 14.56 83 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.7 total, 22.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.01 GB write, 722.72 MB/s write, 10.39 GB read, 469.15 MB/s read, 59.7 seconds Interval compaction: 16.01 GB write, 729.74 MB/s write, 10.39 GB read, 473.71 MB/s read, 59.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 15, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2140365 Average: 2.2725 StdDev: 14.02 Min: 0 Median: 1.4652 Max: 6400 Percentiles: P50: 1.47 P75: 1.84 P99: 5.73 P99.9: 11.68 P99.99: 123.66 ------------------------------------------------------ [ 0, 1 ] 408877 19.103% 19.103% #### ( 1, 2 ] 1421696 66.423% 85.526% ############# ( 2, 3 ] 171503 8.013% 93.539% ## ( 3, 4 ] 76297 3.565% 97.104% # ( 4, 6 ] 47040 2.198% 99.301% ( 6, 10 ] 12210 0.570% 99.872% ( 10, 15 ] 1786 0.083% 99.955% ( 15, 22 ] 316 0.015% 99.970% ( 22, 34 ] 34 0.002% 99.972% ( 34, 51 ] 24 0.001% 99.973% ( 51, 76 ] 10 0.000% 99.973% ( 76, 110 ] 266 0.012% 99.986% ( 110, 170 ] 404 0.019% 100.005% ( 170, 250 ] 171 0.008% 100.013% ( 250, 380 ] 140 0.007% 100.019% ( 380, 580 ] 119 0.006% 100.025% ( 580, 870 ] 103 0.005% 100.029% ( 870, 1300 ] 48 0.002% 100.032% ( 1300, 1900 ] 16 0.001% 100.032% ( 1900, 2900 ] 8 0.000% 100.033% ( 2900, 4400 ] 10 0.000% 100.033% ( 4400, 6600 ] 2 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 384231 Average: 2.6953 StdDev: 15.41 Min: 0 Median: 1.5650 Max: 3199 Percentiles: P50: 1.56 P75: 1.94 P99: 7.67 P99.9: 96.57 P99.99: 256.20 ------------------------------------------------------ [ 0, 1 ] 48236 12.554% 12.554% ### ( 1, 2 ] 254657 66.277% 78.831% ############# ( 2, 3 ] 43177 11.237% 90.068% ## ( 3, 4 ] 18133 4.719% 94.788% # ( 4, 6 ] 14369 3.740% 98.527% # ( 6, 10 ] 4362 1.135% 99.662% ( 10, 15 ] 630 0.164% 99.826% ( 15, 22 ] 116 0.030% 99.857% ( 22, 34 ] 8 0.002% 99.859% ( 34, 51 ] 3 0.001% 99.859% ( 51, 76 ] 13 0.003% 99.863% ( 76, 110 ] 236 0.061% 99.924% ( 110, 170 ] 179 0.047% 99.971% ( 170, 250 ] 70 0.018% 99.989% ( 250, 380 ] 75 0.020% 100.009% ( 380, 580 ] 46 0.012% 100.021% ( 580, 870 ] 23 0.006% 100.027% ( 870, 1300 ] 18 0.005% 100.031% ( 1300, 1900 ] 4 0.001% 100.032% ( 1900, 2900 ] 3 0.001% 100.033% ( 2900, 4400 ] 1 0.000% 100.033% ** Level 2 read latency histogram (micros): Count: 76248 Average: 2.4624 StdDev: 22.98 Min: 1 Median: 1.4984 Max: 4827 Percentiles: P50: 1.50 P75: 1.89 P99: 7.11 P99.9: 31.02 P99.99: 476.43 ------------------------------------------------------ [ 0, 1 ] 13599 17.835% 17.835% #### ( 1, 2 ] 49206 64.534% 82.369% ############# ( 2, 3 ] 7003 9.185% 91.554% ## ( 3, 4 ] 3349 4.392% 95.946% # ( 4, 6 ] 2105 2.761% 98.707% # ( 6, 10 ] 806 1.057% 99.764% ( 10, 15 ] 92 0.121% 99.885% ( 15, 22 ] 11 0.014% 99.899% ( 22, 34 ] 1 0.001% 99.900% ( 34, 51 ] 1 0.001% 99.902% ( 51, 76 ] 3 0.004% 99.906% ( 76, 110 ] 22 0.029% 99.934% ( 110, 170 ] 24 0.031% 99.966% ( 170, 250 ] 8 0.010% 99.976% ( 250, 380 ] 7 0.009% 99.986% ( 380, 580 ] 7 0.009% 99.995% ( 580, 870 ] 2 0.003% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 262101 Average: 4.2195 StdDev: 38.91 Min: 0 Median: 1.6563 Max: 4320 Percentiles: P50: 1.66 P75: 2.29 P99: 10.39 P99.9: 334.28 P99.99: 569.35 ------------------------------------------------------ [ 0, 1 ] 28880 11.019% 11.019% ## ( 1, 2 ] 155685 59.399% 70.418% ############ ( 2, 3 ] 41309 15.761% 86.178% ### ( 3, 4 ] 14778 5.638% 91.817% # ( 4, 6 ] 13794 5.263% 97.079% # ( 6, 10 ] 4949 1.888% 98.968% ( 10, 15 ] 1129 0.431% 99.398% ( 15, 22 ] 186 0.071% 99.469% ( 22, 34 ] 25 0.010% 99.479% ( 34, 51 ] 5 0.002% 99.481% ( 51, 76 ] 12 0.005% 99.485% ( 76, 110 ] 239 0.091% 99.576% ( 110, 170 ] 468 0.179% 99.755% ( 170, 250 ] 249 0.095% 99.850% ( 250, 380 ] 205 0.078% 99.928% ( 380, 580 ] 173 0.066% 99.994% ( 580, 870 ] 76 0.029% 100.023% ( 870, 1300 ] 25 0.010% 100.033% ( 1300, 1900 ] 13 0.005% 100.038% ( 1900, 2900 ] 11 0.004% 100.042% ( 2900, 4400 ] 13 0.005% 100.047% ** Level 4 read latency histogram (micros): Count: 310 Average: 117.6548 StdDev: 527.03 Min: 0 Median: 1.7921 Max: 4945 Percentiles: P50: 1.79 P75: 4.10 P99: 3350.00 P99.9: 4945.00 P99.99: 4945.00 ------------------------------------------------------ [ 0, 1 ] 75 24.194% 24.194% ##### ( 1, 2 ] 101 32.581% 56.774% ####### ( 2, 3 ] 46 14.839% 71.613% ### ( 3, 4 ] 10 3.226% 74.839% # ( 4, 6 ] 10 3.226% 78.065% # ( 6, 10 ] 30 9.677% 87.742% ## ( 10, 15 ] 13 4.194% 91.935% # ( 15, 22 ] 2 0.645% 92.581% ( 22, 34 ] 1 0.323% 92.903% ( 76, 110 ] 1 0.323% 93.226% ( 250, 380 ] 2 0.645% 93.871% ( 380, 580 ] 2 0.645% 94.516% ( 580, 870 ] 1 0.323% 94.839% ( 870, 1300 ] 6 1.935% 96.774% ( 1300, 1900 ] 3 0.968% 97.742% ( 1900, 2900 ] 3 0.968% 98.710% ( 2900, 4400 ] 3 0.968% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 812.6167 StdDev: 957.51 Min: 85 Median: 405.0000 Max: 3912 Percentiles: P50: 405.00 P75: 1085.00 P99: 3912.00 P99.9: 3912.00 P99.99: 3912.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 12 20.000% 40.000% #### ( 170, 250 ] 2 3.333% 43.333% # ( 250, 380 ] 3 5.000% 48.333% # ( 380, 580 ] 8 13.333% 61.667% ### ( 580, 870 ] 6 10.000% 71.667% ## ( 870, 1300 ] 4 6.667% 78.333% # ( 1300, 1900 ] 3 5.000% 83.333% # ( 1900, 2900 ] 7 11.667% 95.000% ## ( 2900, 4400 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 22.7 total, 7.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 260.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.020 H:M:S, 30.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 140.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.384 H:M:S, 62.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/07/27-05:58:52 ... thread 0: (1000000,7000000) ops and (261683.7,266267.0) ops/second in (3.821408,26.289405) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 3.19 GB 81.8 5.4 0.0 5.4 11.9 6.6 0.0 1.8 136.4 303.9 40.18 37.01 113 0.356 5564K 7255 0.0 0.0 L1 12/12 1.42 GB 0.0 3.7 3.2 0.5 3.6 3.2 0.2 1.1 233.7 231.6 16.13 15.62 3 5.375 3826K 32K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.8 1.5 255.9 255.8 0.74 0.71 1 0.738 191K 72 0.0 0.0 L3 23/0 960.49 MB 1.0 3.6 1.8 1.8 3.6 1.7 0.3 2.0 209.3 208.4 17.59 15.78 12 1.466 3740K 15K 0.0 0.0 L4 177/0 9.57 GB 1.0 1.2 1.1 0.1 1.1 1.1 0.8 1.0 138.3 138.1 8.52 5.42 20 0.426 1180K 1240 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1293/24 102.66 GB 0.0 14.0 6.2 7.8 20.5 12.7 5.1 3.1 171.9 252.3 83.16 74.54 149 0.558 14M 57K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.0 6.2 7.8 20.5 12.7 5.0 3.1 171.9 252.3 83.16 74.54 149 0.558 14M 57K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.0 6.2 7.8 13.9 6.1 0.0 0.0 225.5 224.6 63.41 57.54 54 1.174 14M 57K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 341.3 19.75 17.00 95 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.5 total, 26.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.49 GB write, 791.46 MB/s write, 13.96 GB read, 539.39 MB/s read, 83.2 seconds Interval compaction: 20.49 GB write, 798.03 MB/s write, 13.96 GB read, 543.87 MB/s read, 83.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 28, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2517452 Average: 2.4178 StdDev: 18.87 Min: 0 Median: 1.5048 Max: 8018 Percentiles: P50: 1.50 P75: 1.89 P99: 5.93 P99.9: 12.64 P99.99: 131.83 ------------------------------------------------------ [ 0, 1 ] 431778 17.151% 17.151% ### ( 1, 2 ] 1638186 65.073% 82.225% ############# ( 2, 3 ] 234675 9.322% 91.546% ## ( 3, 4 ] 109019 4.331% 95.877% # ( 4, 6 ] 81430 3.235% 99.112% # ( 6, 10 ] 18390 0.731% 99.842% ( 10, 15 ] 2762 0.110% 99.952% ( 15, 22 ] 375 0.015% 99.967% ( 22, 34 ] 36 0.001% 99.968% ( 34, 51 ] 25 0.001% 99.969% ( 51, 76 ] 11 0.000% 99.970% ( 76, 110 ] 336 0.013% 99.983% ( 110, 170 ] 490 0.019% 100.002% ( 170, 250 ] 208 0.008% 100.011% ( 250, 380 ] 183 0.007% 100.018% ( 380, 580 ] 155 0.006% 100.024% ( 580, 870 ] 123 0.005% 100.029% ( 870, 1300 ] 66 0.003% 100.032% ( 1300, 1900 ] 27 0.001% 100.033% ( 1900, 2900 ] 20 0.001% 100.033% ( 2900, 4400 ] 18 0.001% 100.034% ( 4400, 6600 ] 8 0.000% 100.035% ( 6600, 9900 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 567153 Average: 3.3749 StdDev: 44.67 Min: 0 Median: 1.6320 Max: 10600 Percentiles: P50: 1.63 P75: 2.13 P99: 8.41 P99.9: 103.12 P99.99: 436.82 ------------------------------------------------------ [ 0, 1 ] 56500 9.962% 9.962% ## ( 1, 2 ] 359295 63.351% 73.313% ############# ( 2, 3 ] 76206 13.437% 86.749% ### ( 3, 4 ] 33917 5.980% 92.729% # ( 4, 6 ] 30678 5.409% 98.139% # ( 6, 10 ] 8105 1.429% 99.568% ( 10, 15 ] 1471 0.259% 99.827% ( 15, 22 ] 182 0.032% 99.859% ( 22, 34 ] 13 0.002% 99.861% ( 34, 51 ] 5 0.001% 99.862% ( 51, 76 ] 16 0.003% 99.865% ( 76, 110 ] 248 0.044% 99.909% ( 110, 170 ] 215 0.038% 99.947% ( 170, 250 ] 106 0.019% 99.965% ( 250, 380 ] 114 0.020% 99.986% ( 380, 580 ] 89 0.016% 100.001% ( 580, 870 ] 71 0.013% 100.014% ( 870, 1300 ] 44 0.008% 100.022% ( 1300, 1900 ] 17 0.003% 100.025% ( 1900, 2900 ] 59 0.010% 100.035% ( 2900, 4400 ] 16 0.003% 100.038% ( 4400, 6600 ] 5 0.001% 100.039% ( 6600, 9900 ] 3 0.001% 100.039% ( 9900, 14000 ] 1 0.000% 100.039% ** Level 2 read latency histogram (micros): Count: 76248 Average: 2.4624 StdDev: 22.98 Min: 1 Median: 1.4984 Max: 4827 Percentiles: P50: 1.50 P75: 1.89 P99: 7.11 P99.9: 31.02 P99.99: 476.43 ------------------------------------------------------ [ 0, 1 ] 13599 17.835% 17.835% #### ( 1, 2 ] 49206 64.534% 82.369% ############# ( 2, 3 ] 7003 9.185% 91.554% ## ( 3, 4 ] 3349 4.392% 95.946% # ( 4, 6 ] 2105 2.761% 98.707% # ( 6, 10 ] 806 1.057% 99.764% ( 10, 15 ] 92 0.121% 99.885% ( 15, 22 ] 11 0.014% 99.899% ( 22, 34 ] 1 0.001% 99.900% ( 34, 51 ] 1 0.001% 99.902% ( 51, 76 ] 3 0.004% 99.906% ( 76, 110 ] 22 0.029% 99.934% ( 110, 170 ] 24 0.031% 99.966% ( 170, 250 ] 8 0.010% 99.976% ( 250, 380 ] 7 0.009% 99.986% ( 380, 580 ] 7 0.009% 99.995% ( 580, 870 ] 2 0.003% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 700735 Average: 3.9750 StdDev: 44.07 Min: 0 Median: 1.7866 Max: 8802 Percentiles: P50: 1.79 P75: 2.71 P99: 9.05 P99.9: 143.90 P99.99: 272.54 ------------------------------------------------------ [ 0, 1 ] 42295 6.036% 6.036% # ( 1, 2 ] 391650 55.891% 61.927% ########### ( 2, 3 ] 129835 18.528% 80.456% #### ( 3, 4 ] 59038 8.425% 88.881% ## ( 4, 6 ] 61483 8.774% 97.655% ## ( 6, 10 ] 12354 1.763% 99.418% ( 10, 15 ] 2426 0.346% 99.764% ( 15, 22 ] 290 0.041% 99.805% ( 22, 34 ] 37 0.005% 99.811% ( 34, 51 ] 12 0.002% 99.812% ( 51, 76 ] 15 0.002% 99.814% ( 76, 110 ] 267 0.038% 99.853% ( 110, 170 ] 588 0.084% 99.936% ( 170, 250 ] 325 0.046% 99.983% ( 250, 380 ] 288 0.041% 100.024% ( 380, 580 ] 262 0.037% 100.061% ( 580, 870 ] 137 0.020% 100.081% ( 870, 1300 ] 67 0.010% 100.090% ( 1300, 1900 ] 35 0.005% 100.095% ( 1900, 2900 ] 38 0.005% 100.101% ( 2900, 4400 ] 37 0.005% 100.106% ( 4400, 6600 ] 5 0.001% 100.107% ( 6600, 9900 ] 3 0.000% 100.107% ** Level 4 read latency histogram (micros): Count: 14543 Average: 104.4100 StdDev: 496.50 Min: 0 Median: 1.9782 Max: 9159 Percentiles: P50: 1.98 P75: 3.46 P99: 2754.43 P99.9: 5724.32 P99.99: 7328.69 ------------------------------------------------------ [ 0, 1 ] 599 4.119% 4.119% # ( 1, 2 ] 6821 46.902% 51.021% ######### ( 2, 3 ] 2747 18.889% 69.910% #### ( 3, 4 ] 1608 11.057% 80.967% ## ( 4, 6 ] 1097 7.543% 88.510% ## ( 6, 10 ] 275 1.891% 90.401% ( 10, 15 ] 115 0.791% 91.192% ( 15, 22 ] 6 0.041% 91.233% ( 22, 34 ] 1 0.007% 91.240% ( 34, 51 ] 1 0.007% 91.247% ( 76, 110 ] 29 0.199% 91.446% ( 110, 170 ] 84 0.578% 92.024% ( 170, 250 ] 86 0.591% 92.615% ( 250, 380 ] 146 1.004% 93.619% ( 380, 580 ] 205 1.410% 95.029% ( 580, 870 ] 229 1.575% 96.603% ( 870, 1300 ] 159 1.093% 97.696% ( 1300, 1900 ] 99 0.681% 98.377% ( 1900, 2900 ] 106 0.729% 99.106% ( 2900, 4400 ] 98 0.674% 99.780% ( 4400, 6600 ] 29 0.199% 99.979% ( 6600, 9900 ] 7 0.048% 100.028% ** Level 5 read latency histogram (micros): Count: 120 Average: 1236.0417 StdDev: 1320.70 Min: 85 Median: 704.2857 Max: 5658 Percentiles: P50: 704.29 P75: 1833.33 P99: 5658.00 P99.9: 5658.00 P99.99: 5658.00 ------------------------------------------------------ ( 76, 110 ] 15 12.500% 12.500% ### ( 110, 170 ] 14 11.667% 24.167% ## ( 170, 250 ] 4 3.333% 27.500% # ( 250, 380 ] 6 5.000% 32.500% # ( 380, 580 ] 15 12.500% 45.000% ### ( 580, 870 ] 14 11.667% 56.667% ## ( 870, 1300 ] 14 11.667% 68.333% ## ( 1300, 1900 ] 9 7.500% 75.833% ## ( 1900, 2900 ] 11 9.167% 85.000% ## ( 2900, 4400 ] 15 12.500% 97.500% ### ( 4400, 6600 ] 3 2.500% 100.000% # ** DB Stats ** Uptime(secs): 26.5 total, 3.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 259.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.930 H:M:S, 29.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 257.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.910 H:M:S, 23.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-05:58:57 ... thread 0: (1000000,8000000) ops and (218694.1,259218.4) ops/second in (4.572597,30.862002) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 4.24 GB 220.3 6.7 0.0 6.7 14.3 7.6 0.0 1.9 141.9 303.1 48.39 44.79 134 0.361 6971K 8741 0.0 0.0 L1 12/12 1.42 GB 0.0 3.7 3.2 0.5 3.6 3.2 0.2 1.1 233.7 231.6 16.13 15.62 3 5.375 3826K 32K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.8 1.5 255.9 255.8 0.74 0.71 1 0.738 191K 72 0.0 0.0 L3 23/0 960.49 MB 1.0 3.6 1.8 1.8 3.6 1.7 0.3 2.0 209.3 208.4 17.59 15.78 12 1.466 3740K 15K 0.0 0.0 L4 177/0 9.57 GB 1.0 1.2 1.1 0.1 1.1 1.1 0.8 1.0 138.3 138.1 8.52 5.42 20 0.426 1180K 1240 0.0 0.0 L5 1064/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/20 103.71 GB 0.0 15.3 6.2 9.1 22.9 13.7 5.1 3.0 171.7 256.5 91.38 82.32 170 0.538 15M 58K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.3 6.2 9.1 22.9 13.7 5.0 3.0 171.7 256.5 91.38 82.32 170 0.538 15M 58K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.3 6.2 9.1 15.3 6.1 0.0 0.0 228.7 227.8 68.59 62.62 59 1.163 15M 58K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 342.9 22.78 19.70 111 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.1 total, 30.9 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.89 GB write, 754.03 MB/s write, 15.32 GB read, 504.63 MB/s read, 91.4 seconds Interval compaction: 22.89 GB write, 759.36 MB/s write, 15.32 GB read, 508.20 MB/s read, 91.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 29, interval: 48 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2983073 Average: 2.3859 StdDev: 17.88 Min: 0 Median: 1.5001 Max: 8018 Percentiles: P50: 1.50 P75: 1.88 P99: 5.91 P99.9: 12.27 P99.99: 121.99 ------------------------------------------------------ [ 0, 1 ] 514774 17.257% 17.257% ### ( 1, 2 ] 1953301 65.479% 82.736% ############# ( 2, 3 ] 273020 9.152% 91.888% ## ( 3, 4 ] 125432 4.205% 96.093% # ( 4, 6 ] 90756 3.042% 99.135% # ( 6, 10 ] 21406 0.718% 99.853% ( 10, 15 ] 3088 0.104% 99.957% ( 15, 22 ] 400 0.013% 99.970% ( 22, 34 ] 39 0.001% 99.971% ( 34, 51 ] 27 0.001% 99.972% ( 51, 76 ] 15 0.001% 99.973% ( 76, 110 ] 399 0.013% 99.986% ( 110, 170 ] 589 0.020% 100.006% ( 170, 250 ] 229 0.008% 100.013% ( 250, 380 ] 195 0.007% 100.020% ( 380, 580 ] 169 0.006% 100.026% ( 580, 870 ] 132 0.004% 100.030% ( 870, 1300 ] 71 0.002% 100.032% ( 1300, 1900 ] 28 0.001% 100.033% ( 1900, 2900 ] 23 0.001% 100.034% ( 2900, 4400 ] 20 0.001% 100.035% ( 4400, 6600 ] 8 0.000% 100.035% ( 6600, 9900 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 686876 Average: 3.2262 StdDev: 40.84 Min: 0 Median: 1.6063 Max: 10600 Percentiles: P50: 1.61 P75: 2.00 P99: 8.37 P99.9: 107.27 P99.99: 443.36 ------------------------------------------------------ [ 0, 1 ] 76320 11.111% 11.111% ## ( 1, 2 ] 440601 64.146% 75.257% ############# ( 2, 3 ] 86317 12.567% 87.823% ### ( 3, 4 ] 37663 5.483% 93.307% # ( 4, 6 ] 33209 4.835% 98.141% # ( 6, 10 ] 9955 1.449% 99.591% ( 10, 15 ] 1559 0.227% 99.818% ( 15, 22 ] 191 0.028% 99.846% ( 22, 34 ] 13 0.002% 99.847% ( 34, 51 ] 5 0.001% 99.848% ( 51, 76 ] 37 0.005% 99.854% ( 76, 110 ] 347 0.051% 99.904% ( 110, 170 ] 284 0.041% 99.945% ( 170, 250 ] 139 0.020% 99.966% ( 250, 380 ] 135 0.020% 99.985% ( 380, 580 ] 102 0.015% 100.000% ( 580, 870 ] 75 0.011% 100.011% ( 870, 1300 ] 45 0.007% 100.018% ( 1300, 1900 ] 18 0.003% 100.020% ( 1900, 2900 ] 59 0.009% 100.029% ( 2900, 4400 ] 16 0.002% 100.031% ( 4400, 6600 ] 5 0.001% 100.032% ( 6600, 9900 ] 3 0.000% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ** Level 2 read latency histogram (micros): Count: 76248 Average: 2.4624 StdDev: 22.98 Min: 1 Median: 1.4984 Max: 4827 Percentiles: P50: 1.50 P75: 1.89 P99: 7.11 P99.9: 31.02 P99.99: 476.43 ------------------------------------------------------ [ 0, 1 ] 13599 17.835% 17.835% #### ( 1, 2 ] 49206 64.534% 82.369% ############# ( 2, 3 ] 7003 9.185% 91.554% ## ( 3, 4 ] 3349 4.392% 95.946% # ( 4, 6 ] 2105 2.761% 98.707% # ( 6, 10 ] 806 1.057% 99.764% ( 10, 15 ] 92 0.121% 99.885% ( 15, 22 ] 11 0.014% 99.899% ( 22, 34 ] 1 0.001% 99.900% ( 34, 51 ] 1 0.001% 99.902% ( 51, 76 ] 3 0.004% 99.906% ( 76, 110 ] 22 0.029% 99.934% ( 110, 170 ] 24 0.031% 99.966% ( 170, 250 ] 8 0.010% 99.976% ( 250, 380 ] 7 0.009% 99.986% ( 380, 580 ] 7 0.009% 99.995% ( 580, 870 ] 2 0.003% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 700735 Average: 3.9750 StdDev: 44.07 Min: 0 Median: 1.7866 Max: 8802 Percentiles: P50: 1.79 P75: 2.71 P99: 9.05 P99.9: 143.90 P99.99: 272.54 ------------------------------------------------------ [ 0, 1 ] 42295 6.036% 6.036% # ( 1, 2 ] 391650 55.891% 61.927% ########### ( 2, 3 ] 129835 18.528% 80.456% #### ( 3, 4 ] 59038 8.425% 88.881% ## ( 4, 6 ] 61483 8.774% 97.655% ## ( 6, 10 ] 12354 1.763% 99.418% ( 10, 15 ] 2426 0.346% 99.764% ( 15, 22 ] 290 0.041% 99.805% ( 22, 34 ] 37 0.005% 99.811% ( 34, 51 ] 12 0.002% 99.812% ( 51, 76 ] 15 0.002% 99.814% ( 76, 110 ] 267 0.038% 99.853% ( 110, 170 ] 588 0.084% 99.936% ( 170, 250 ] 325 0.046% 99.983% ( 250, 380 ] 288 0.041% 100.024% ( 380, 580 ] 262 0.037% 100.061% ( 580, 870 ] 137 0.020% 100.081% ( 870, 1300 ] 67 0.010% 100.090% ( 1300, 1900 ] 35 0.005% 100.095% ( 1900, 2900 ] 38 0.005% 100.101% ( 2900, 4400 ] 37 0.005% 100.106% ( 4400, 6600 ] 5 0.001% 100.107% ( 6600, 9900 ] 3 0.000% 100.107% ** Level 4 read latency histogram (micros): Count: 14543 Average: 104.4100 StdDev: 496.50 Min: 0 Median: 1.9782 Max: 9159 Percentiles: P50: 1.98 P75: 3.46 P99: 2754.43 P99.9: 5724.32 P99.99: 7328.69 ------------------------------------------------------ [ 0, 1 ] 599 4.119% 4.119% # ( 1, 2 ] 6821 46.902% 51.021% ######### ( 2, 3 ] 2747 18.889% 69.910% #### ( 3, 4 ] 1608 11.057% 80.967% ## ( 4, 6 ] 1097 7.543% 88.510% ## ( 6, 10 ] 275 1.891% 90.401% ( 10, 15 ] 115 0.791% 91.192% ( 15, 22 ] 6 0.041% 91.233% ( 22, 34 ] 1 0.007% 91.240% ( 34, 51 ] 1 0.007% 91.247% ( 76, 110 ] 29 0.199% 91.446% ( 110, 170 ] 84 0.578% 92.024% ( 170, 250 ] 86 0.591% 92.615% ( 250, 380 ] 146 1.004% 93.619% ( 380, 580 ] 205 1.410% 95.029% ( 580, 870 ] 229 1.575% 96.603% ( 870, 1300 ] 159 1.093% 97.696% ( 1300, 1900 ] 99 0.681% 98.377% ( 1900, 2900 ] 106 0.729% 99.106% ( 2900, 4400 ] 98 0.674% 99.780% ( 4400, 6600 ] 29 0.199% 99.979% ( 6600, 9900 ] 7 0.048% 100.028% ** Level 5 read latency histogram (micros): Count: 120 Average: 1236.0417 StdDev: 1320.70 Min: 85 Median: 704.2857 Max: 5658 Percentiles: P50: 704.29 P75: 1833.33 P99: 5658.00 P99.9: 5658.00 P99.99: 5658.00 ------------------------------------------------------ ( 76, 110 ] 15 12.500% 12.500% ### ( 110, 170 ] 14 11.667% 24.167% ## ( 170, 250 ] 4 3.333% 27.500% # ( 250, 380 ] 6 5.000% 32.500% # ( 380, 580 ] 15 12.500% 45.000% ### ( 580, 870 ] 14 11.667% 56.667% ## ( 870, 1300 ] 14 11.667% 68.333% ## ( 1300, 1900 ] 9 7.500% 75.833% ## ( 1900, 2900 ] 11 9.167% 85.000% ## ( 2900, 4400 ] 15 12.500% 97.500% ### ( 4400, 6600 ] 3 2.500% 100.000% # ** DB Stats ** Uptime(secs): 31.1 total, 4.6 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 253.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.769 H:M:S, 31.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 215.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.839 H:M:S, 40.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/27-05:59:09 ... thread 0: (1000000,9000000) ops and (79702.4,207331.8) ops/second in (12.546676,43.408678) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/17 3.07 GB 0.0 8.0 0.0 8.0 16.5 8.5 0.0 1.9 145.2 300.3 56.38 52.00 150 0.376 8313K 13K 0.0 0.0 L1 17/17 2.04 GB 0.0 7.2 5.3 1.9 7.1 5.2 0.2 1.3 227.5 224.9 32.37 30.66 4 8.091 7476K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.2 1.5 255.9 255.8 0.74 0.71 1 0.738 191K 72 0.0 0.0 L3 18/0 936.52 MB 0.9 6.2 3.1 3.1 6.1 3.0 0.4 2.0 205.7 204.7 30.77 27.61 22 1.398 6428K 31K 0.0 0.0 L4 172/0 9.64 GB 1.0 2.8 2.5 0.3 2.8 2.5 0.8 1.1 156.5 156.0 18.25 12.90 37 0.493 2849K 4665 0.0 0.0 L5 1080/0 88.89 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/34 104.55 GB 0.0 24.3 11.0 13.4 32.8 19.4 8.0 3.8 179.9 242.2 138.51 123.88 214 0.647 25M 133K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.3 11.0 13.4 32.8 19.4 7.9 3.8 179.9 242.2 138.51 123.88 214 0.647 25M 133K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.3 11.0 13.4 24.2 10.8 0.0 0.0 220.9 219.7 112.84 101.79 89 1.268 25M 133K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 341.1 25.67 22.09 125 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.6 total, 43.4 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.76 GB write, 768.82 MB/s write, 24.34 GB read, 571.26 MB/s read, 138.5 seconds Interval compaction: 32.76 GB write, 772.69 MB/s write, 24.34 GB read, 574.13 MB/s read, 138.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 23, pending-compaction-bytes-stops: 0, total-delays: 46, total-stops: 33, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3799260 Average: 2.6272 StdDev: 20.56 Min: 0 Median: 1.5078 Max: 8018 Percentiles: P50: 1.51 P75: 1.89 P99: 6.59 P99.9: 99.45 P99.99: 252.89 ------------------------------------------------------ [ 0, 1 ] 649120 17.085% 17.085% ### ( 1, 2 ] 2462650 64.819% 81.905% ############# ( 2, 3 ] 355193 9.349% 91.254% ## ( 3, 4 ] 162666 4.282% 95.535% # ( 4, 6 ] 126791 3.337% 98.872% # ( 6, 10 ] 32713 0.861% 99.733% ( 10, 15 ] 4399 0.116% 99.849% ( 15, 22 ] 537 0.014% 99.863% ( 22, 34 ] 45 0.001% 99.865% ( 34, 51 ] 31 0.001% 99.865% ( 51, 76 ] 21 0.001% 99.866% ( 76, 110 ] 1879 0.049% 99.915% ( 110, 170 ] 2142 0.056% 99.972% ( 170, 250 ] 683 0.018% 99.990% ( 250, 380 ] 499 0.013% 100.003% ( 380, 580 ] 453 0.012% 100.015% ( 580, 870 ] 304 0.008% 100.023% ( 870, 1300 ] 170 0.004% 100.027% ( 1300, 1900 ] 60 0.002% 100.029% ( 1900, 2900 ] 38 0.001% 100.030% ( 2900, 4400 ] 27 0.001% 100.031% ( 4400, 6600 ] 10 0.000% 100.031% ( 6600, 9900 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 1282819 Average: 3.3865 StdDev: 36.07 Min: 0 Median: 1.6376 Max: 10600 Percentiles: P50: 1.64 P75: 2.23 P99: 8.84 P99.9: 114.73 P99.99: 356.91 ------------------------------------------------------ [ 0, 1 ] 144183 11.240% 11.240% ## ( 1, 2 ] 779895 60.795% 72.035% ############ ( 2, 3 ] 168298 13.119% 85.154% ### ( 3, 4 ] 82854 6.459% 91.613% # ( 4, 6 ] 78832 6.145% 97.758% # ( 6, 10 ] 22429 1.748% 99.507% ( 10, 15 ] 3666 0.286% 99.792% ( 15, 22 ] 443 0.035% 99.827% ( 22, 34 ] 28 0.002% 99.829% ( 34, 51 ] 10 0.001% 99.830% ( 51, 76 ] 97 0.008% 99.838% ( 76, 110 ] 751 0.059% 99.896% ( 110, 170 ] 636 0.050% 99.946% ( 170, 250 ] 322 0.025% 99.971% ( 250, 380 ] 300 0.023% 99.994% ( 380, 580 ] 315 0.025% 100.019% ( 580, 870 ] 232 0.018% 100.037% ( 870, 1300 ] 128 0.010% 100.047% ( 1300, 1900 ] 51 0.004% 100.051% ( 1900, 2900 ] 68 0.005% 100.056% ( 2900, 4400 ] 26 0.002% 100.058% ( 4400, 6600 ] 5 0.000% 100.058% ( 6600, 9900 ] 3 0.000% 100.059% ( 9900, 14000 ] 1 0.000% 100.059% ** Level 2 read latency histogram (micros): Count: 76248 Average: 2.4624 StdDev: 22.98 Min: 1 Median: 1.4984 Max: 4827 Percentiles: P50: 1.50 P75: 1.89 P99: 7.11 P99.9: 31.02 P99.99: 476.43 ------------------------------------------------------ [ 0, 1 ] 13599 17.835% 17.835% #### ( 1, 2 ] 49206 64.534% 82.369% ############# ( 2, 3 ] 7003 9.185% 91.554% ## ( 3, 4 ] 3349 4.392% 95.946% # ( 4, 6 ] 2105 2.761% 98.707% # ( 6, 10 ] 806 1.057% 99.764% ( 10, 15 ] 92 0.121% 99.885% ( 15, 22 ] 11 0.014% 99.899% ( 22, 34 ] 1 0.001% 99.900% ( 34, 51 ] 1 0.001% 99.902% ( 51, 76 ] 3 0.004% 99.906% ( 76, 110 ] 22 0.029% 99.934% ( 110, 170 ] 24 0.031% 99.966% ( 170, 250 ] 8 0.010% 99.976% ( 250, 380 ] 7 0.009% 99.986% ( 380, 580 ] 7 0.009% 99.995% ( 580, 870 ] 2 0.003% 99.997% ( 2900, 4400 ] 1 0.001% 99.999% ( 4400, 6600 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1392533 Average: 3.8446 StdDev: 37.88 Min: 0 Median: 1.8564 Max: 10697 Percentiles: P50: 1.86 P75: 2.90 P99: 8.81 P99.9: 16.98 P99.99: 140.10 ------------------------------------------------------ [ 0, 1 ] 60607 4.352% 4.352% # ( 1, 2 ] 742278 53.304% 57.656% ########### ( 2, 3 ] 267775 19.229% 76.886% #### ( 3, 4 ] 141330 10.149% 87.035% ## ( 4, 6 ] 148291 10.649% 97.684% ## ( 6, 10 ] 26130 1.876% 99.560% ( 10, 15 ] 4586 0.329% 99.890% ( 15, 22 ] 506 0.036% 99.926% ( 22, 34 ] 59 0.004% 99.930% ( 34, 51 ] 15 0.001% 99.931% ( 51, 76 ] 81 0.006% 99.937% ( 76, 110 ] 347 0.025% 99.962% ( 110, 170 ] 775 0.056% 100.018% ( 170, 250 ] 550 0.039% 100.057% ( 250, 380 ] 512 0.037% 100.094% ( 380, 580 ] 435 0.031% 100.125% ( 580, 870 ] 273 0.020% 100.145% ( 870, 1300 ] 141 0.010% 100.155% ( 1300, 1900 ] 51 0.004% 100.159% ( 1900, 2900 ] 52 0.004% 100.162% ( 2900, 4400 ] 46 0.003% 100.166% ( 4400, 6600 ] 8 0.001% 100.166% ( 6600, 9900 ] 3 0.000% 100.166% ( 9900, 14000 ] 1 0.000% 100.167% ** Level 4 read latency histogram (micros): Count: 69477 Average: 43.3147 StdDev: 292.39 Min: 0 Median: 1.9193 Max: 9159 Percentiles: P50: 1.92 P75: 3.22 P99: 1150.14 P99.9: 4046.44 P99.99: 5889.60 ------------------------------------------------------ [ 0, 1 ] 2566 3.693% 3.693% # ( 1, 2 ] 34998 50.374% 54.067% ########## ( 2, 3 ] 12923 18.600% 72.667% #### ( 3, 4 ] 7336 10.559% 83.226% ## ( 4, 6 ] 6575 9.464% 92.690% ## ( 6, 10 ] 1543 2.221% 94.911% ( 10, 15 ] 461 0.664% 95.574% ( 15, 22 ] 32 0.046% 95.620% ( 22, 34 ] 5 0.007% 95.627% ( 34, 51 ] 1 0.001% 95.629% ( 51, 76 ] 4 0.006% 95.635% ( 76, 110 ] 91 0.131% 95.766% ( 110, 170 ] 264 0.380% 96.145% ( 170, 250 ] 321 0.462% 96.608% ( 250, 380 ] 402 0.579% 97.186% ( 380, 580 ] 511 0.735% 97.922% ( 580, 870 ] 516 0.743% 98.664% ( 870, 1300 ] 358 0.515% 99.180% ( 1300, 1900 ] 201 0.289% 99.469% ( 1900, 2900 ] 178 0.256% 99.725% ( 2900, 4400 ] 159 0.229% 99.954% ( 4400, 6600 ] 37 0.053% 100.007% ( 6600, 9900 ] 11 0.016% 100.023% ** Level 5 read latency histogram (micros): Count: 200 Average: 1209.3500 StdDev: 1350.40 Min: 81 Median: 684.4000 Max: 7831 Percentiles: P50: 684.40 P75: 1758.82 P99: 6160.00 P99.9: 7831.00 P99.99: 7831.00 ------------------------------------------------------ ( 76, 110 ] 22 11.000% 11.000% ## ( 110, 170 ] 23 11.500% 22.500% ## ( 170, 250 ] 9 4.500% 27.000% # ( 250, 380 ] 14 7.000% 34.000% # ( 380, 580 ] 23 11.500% 45.500% ## ( 580, 870 ] 25 12.500% 58.000% ### ( 870, 1300 ] 21 10.500% 68.500% ## ( 1300, 1900 ] 17 8.500% 77.000% ## ( 1900, 2900 ] 19 9.500% 86.500% ## ( 2900, 4400 ] 21 10.500% 97.000% ## ( 4400, 6600 ] 5 2.500% 99.500% # ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 43.6 total, 12.5 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 203.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.284 H:M:S, 44.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 78.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.515 H:M:S, 75.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.105 micros/op 163794 ops/sec 60.112 seconds 9845999 operations; 158.7 MB/s Microseconds per write: Count: 9845999 Average: 6.1050 StdDev: 280.76 Min: 1 Median: 1.7361 Max: 270582 Percentiles: P50: 1.74 P75: 2.70 P99: 9.61 P99.9: 1177.62 P99.99: 2696.98 ------------------------------------------------------ [ 0, 1 ] 1383484 14.051% 14.051% ### ( 1, 2 ] 4808562 48.838% 62.889% ########## ( 2, 3 ] 1705905 17.326% 80.215% ### ( 3, 4 ] 1269513 12.894% 93.109% ### ( 4, 6 ] 459932 4.671% 97.780% # ( 6, 10 ] 133126 1.352% 99.132% ( 10, 15 ] 41714 0.424% 99.556% ( 15, 22 ] 8236 0.084% 99.639% ( 22, 34 ] 1611 0.016% 99.656% ( 34, 51 ] 218 0.002% 99.658% ( 51, 76 ] 26 0.000% 99.658% ( 76, 110 ] 7304 0.074% 99.732% ( 110, 170 ] 2276 0.023% 99.755% ( 170, 250 ] 224 0.002% 99.758% ( 250, 380 ] 188 0.002% 99.759% ( 380, 580 ] 36 0.000% 99.760% ( 580, 870 ] 18 0.000% 99.760% ( 870, 1300 ] 19262 0.196% 99.956% ( 1300, 1900 ] 107 0.001% 99.957% ( 1900, 2900 ] 4106 0.042% 99.998% ( 2900, 4400 ] 103 0.001% 100.000% ( 4400, 6600 ] 22 0.000% 100.000% ( 6600, 9900 ] 6 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 228420 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9845999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10161070968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 571 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33096079 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34178783845 rocksdb.compact.write.bytes COUNT : 33935714709 rocksdb.flush.write.bytes COUNT : 10106781204 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 48 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 285 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10025307136 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3926016 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34273917765 rocksdb.non.last.level.read.count COUNT : 8280007 rocksdb.block.checksum.compute.count COUNT : 8278913 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.379926 P95 : 3.891967 P99 : 8.328550 P100 : 270580.000000 COUNT : 9845999 SUM : 55508541 rocksdb.compaction.times.micros P50 : 976571.428571 P95 : 4020000.000000 P99 : 18160000.000000 P100 : 21403200.000000 COUNT : 96 SUM : 144685115 rocksdb.compaction.times.cpu_micros P50 : 934634.146341 P95 : 3740000.000000 P99 : 18160000.000000 P100 : 19715942.000000 COUNT : 96 SUM : 131623192 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 687.820513 P95 : 1245.533333 P99 : 5082.000000 P100 : 5477.000000 COUNT : 138 SUM : 106772 rocksdb.compaction.outfile.sync.micros P50 : 931.146789 P95 : 7741.250000 P99 : 19168.000000 P100 : 31417.000000 COUNT : 377 SUM : 734962 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.855422 P95 : 638.000000 P99 : 1516.000000 P100 : 4094.000000 COUNT : 264 SUM : 54311 rocksdb.table.open.io.micros P50 : 1363.000000 P95 : 7199.210526 P99 : 12617.181818 P100 : 17297.000000 COUNT : 571 SUM : 1147305 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.627158 P95 : 7.713112 P99 : 10.871539 P100 : 10702.000000 COUNT : 8277460 SUM : 44930931 rocksdb.read.block.get.micros P50 : 469.719626 P95 : 3306.363636 P99 : 5218.400000 P100 : 11655.000000 COUNT : 1142 SUM : 933272 rocksdb.write.raw.block.micros P50 : 0.511376 P95 : 0.971614 P99 : 2.699575 P100 : 11652.000000 COUNT : 10669147 SUM : 19308900 rocksdb.numfiles.in.singlecompaction P50 : 3.080645 P95 : 6.900000 P99 : 20.530000 P100 : 26.000000 COUNT : 142 SUM : 528 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559025 P95 : 1145.737500 P99 : 2379.331707 P100 : 270352.000000 COUNT : 224074 SUM : 33117828 rocksdb.sst.read.micros P50 : 1.569504 P95 : 4.660493 P99 : 8.347205 P100 : 10697.000000 COUNT : 8280498 SUM : 28095191 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9845999 SUM : 10161070968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 205955.056180 P95 : 350176.470588 P99 : 482600.000000 P100 : 487350.000000 COUNT : 138 SUM : 28130625 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 371 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0