High CPU and disk read/write, very large (2GB) state.db on k3s 1.22.9 about k3s

[brandond]

As you noted, v1.22.9 is a quite old release. There have been a number of improvements to the compact logic made in newer releases, so I suspect that things might be improved by newer versions. However, the messages you're seeing indicate that a combination of slow disk IO and high datastore write volume has filled to the database to the point where compaction can no longer run in the allotted time, and old rows are not being purged.

Follow the steps from this comment to figure out what's filling your database: #1575 (comment)

You can then run this query to manually compact the old rows:

delete from kine where id in (select id  from (select id,name from kine where id NOT IN (select max(id) as  id from kine group by name)) as t);