Ah, that makes sense too. I just wanted to add my two cents as a software developer. Could be either database rows or graphical rows, I guess.

¹ “ROWS” probably means database rows/records. Therefore I would assume one row = 1📍.

Same issue for me. My workaround is to remove the anonymous account and let Aurora Store fetch another one. It might take two or three attempts before you get one that works.

Hi, thanks for posting this guide!

I tried it on a modern laptop with 32GB of unified memory. It starts at 40 tok/s when loading the context, but the output drops to 3 tok/s.

Could I ask you which GPU you are using for these tests? What context size would a 16GB GPU give?

In my case it wasn’t a total freeze but rather just a massive slowdown. It would happen at random, especially in Desktop mode when I had too many things open. My device is a ROG Ally Z1 Extreme (16 GB of unified memory), Bazzite in gaming mode.

I permanently solved the issue by simply adding a bit of swap memory.

If your goal is to host services, I would recommend looking into Docker, and eventually Podman. Containerization lets you keep the configuration wherever you want, personally I use a dedicated a directory for each service.

Also, please note that a container is not a VM. It’s just a way to keep everything in one place.