Our software engineers are more and more working with AI which sometimes raises entirely new requirements on the environment.
One of those is that we wanted to pin larger language models (in this case platypus2 70B parameters, or falcon 40B) to memory on a development host that runs microk8s. Long story is that we needed to increase the ulimit in order to be able to load the model and lock it to memory.
The default (also the default when using plain containerd) is ulimit -n 65536.
To increase it on microk8s, open /var/snap/microk8s/current/args/containerd-env and set a value that fulfills your needs.
Having adjusted it, just restart the microk8s and it's applied. Easy win :-)