You've successfully subscribed to Nuvotex Blog
Great! Next, complete checkout for full access to Nuvotex Blog
Welcome back! You've successfully signed in.
Success! Your account is fully activated, you now have access to all content.
Success! Your billing info is updated.
Billing info update failed.

Adjusting the ulimit on microk8s

Daniel Nachtrub
Daniel Nachtrub

Our software engineers are more and more working with AI which sometimes raises entirely new requirements on the environment.

One of those is that we wanted to pin larger language models (in this case platypus2 70B parameters, or falcon 40B) to memory on a development host that runs microk8s. Long story is that we needed to increase the ulimit in order to be able to load the model and lock it to memory.

The default (also the default when using plain containerd) is ulimit -n 65536.

To increase it on microk8s, open /var/snap/microk8s/current/args/containerd-env and set a value that fulfills your needs.

Having adjusted it, just restart the microk8s and it's applied. Easy win :-)

Daniel Nachtrub

Kind of likes computers. Linux foundation certified: LFCS / CKA / CKAD / CKS. Microsoft certified: Cybersecurity Architect Expert & Azure Solutions Architect Expert.