On a normal setup without leads or crazy customisation, it’ll be a breeze 👍

Pipe tree to a text file?

Not sure what device you use to access Reddit, but have you tried the revanced patched APK on android? This might just solve your problem.

You’re determined that I worry about my public server aren’t you? Your initial question wasn’t actually a question, but just a trap for you to lure me into to be converted to your way of thinking?!?! rumbled! 😂 There are always experts to quote for any argument. Personally, I don’t feel any more vulnerable than before ai decimated the security landscape.

Maybe not, but maybe, just maybe, the people with these exploits aren’t running round attacking Joe bloggs personal photo album server to steal some photos, but in fact are only using the exploit very carefully and sparingly so as not to be detected, and only targeting high value and highly confidential services, where even if they were hacked or a specific exploit was deployed, either are too big to notice, or to proud to divulge the fact they lost some data 🤷

To me there is no increased threat landscape. The world is a scary place, full of baddies trying to get you. Since the dawn of the internet there has been vulnerabilities being found and used maliciously. Just because the big tech sota models are shouting about how great they are by finding them, giving them some nice free marketing, doesn’t mean that much has changed.

Ok, ai has increased the frequency and amount being found, but that is equally increased both for malicious and cybersec, so it essentially cancels out.

My server is public facing and secure, so that both myself, family and friends can use it, especially for the less tech savvy.

10000% correct! I bet the NSA or KGB has had that PHP exploit for close to a decade and they are gutted its finally been patched! There are probably an infinite number of vulnerabilities in currently running servers and clients, a few 100 will already be known and being quietly exploited. Yes, ai will find some completely unknown ones for malicious actors, but it will also find those same ones for cybersec bods, so effectively cancel each other out.

Thats exactly what all this is. If the SOTA models find a “critical” vulnerability every month or so, they get a huge shout out in the news and press globally which is some really appreciated and positive free marketing. Yes, ai has changed alot of things, some for the good some for the bad, but i dont feel like online risk has changed massively. AI finds vulnerabilities for milicious actors and cybersec bods quicker and more regularly than pre-ai, but both sides have the same tools so the same improvements, net effect is they cancel each other out. Anybody with serious about there stuff online already has sytems and processes setup to deal with patching stuff immediately. i barely touch my server for maintenance, just check stuff when im bored and make sure everything is doing what it should.

I have no idea what you are on about. What do you want me to do? Turn the internet off? Lock my doors and not leave the house? Sit here crying and quivering because the world is gonna end? My head is deffo not in the sand, I’m looking out the window at the rain, enjoying my life, looking forward to tomorrow.

I’m not worried about my web server any more today then I was last year. It’s a web server, it’s not me or my life, yes it how important stuff, but if the world ends it’ll be the last thing I think of.

My web server is as safe as it needs to be. Thanks for your concern.

Ai tomorrow better than ai today? Yes, that is true any day of any year. I don’t get your point 🤷

A vulnerability was found, that vulnerability was patched. I think it’s great news that vulnerabilities are being found and fixed faster than ever. Do you agree?

To be fair, my server has been public facing for the entire time these ai models have been finding vulnerabilities.

I’m not worried. I have auto updates on and have a well hardened setup following all the good basic principles. I have had a fully public facing server for years with no issues. My php was patched and updated totally automatically a few hours after the update became available. My web server is extremely low volume traffic and there is hardly any reason for random people to be using it, so chances of somebody attempting something against it at just the right time a vulnerability has been discovered but not patched is very low chance. When a critical vulnerability appears, hackers are going to target the big fish for big wins initially, even so, it takes effort to turn a vulnerability into an actual exploit and deploy it. I could step out my front door and get run over by a bus, but I don’t worry about it and stay on doors all day to mitigate the risk.

You’re not me. You will have different tastes too me. No point you using the distros I like. Do what everybody else does, experiment, try a few, read about them. The are loads out there all with little quirks and differences. Try L/K/X/Ubuntu, try cachyos / arch, try void, try Gentoo, try popos… Have a look at distrowatch for loads of inspiration.

Any and all distros can use and run any software any other distro runs so they can all do the same stuff, just they all get there in slightly different ways.

Yeah, I know how to do that very easily, but I don’t want to have my pc running 24/7 just so I can use the llm when I’m out of the house. My heaviest use is at home. It’s a large power requirement for minimal use.

Yeah, I have a fairly useable setup although it’s only accessible on my lan. I have a web server but it doesn’t host the llm as it’s not powerful enough.

Rx7600 8gb vram GPU 5700x CPU 64gb 3600mts ram

Hosting ornith 35b a3b iq4_xs Llama.cpp server Pi harness or llama.cpp webui Searxng web search Coding sandbox Restricted filesystem access

Get around 40 tok / sec and it’s really useable. Not as good as Claude sonnet, but good enough for most things.

Yes there are lots of methods to do this. Format the disk to something like ext4, untar a distro to it, then with wsl chroot into the disk, finish installing and configuring everything, then reboot to the new disk. You will need specific time to do an this, but should be fairly straight forward.

I essentially did exactly this for my current setup.

There are other ways to.

My instance of Lemmy doesn’t support down votes, and I’m sure others are the same.

After about a year on void Linux, I would agree. It’s a great, solid, and underrated distro 👍

My always on server hosting 20+ services draws no more than 50w at peak during the night backup, but that lasts maybe an hour or so, normally runs nearer 5w-10w when the hdd’s are spun down and unmounted 22 hours a day. I use an Intel n97 CPU in a mini pc. Navidrome, immich, adguard home, Lemmy, find my device, forgejo, file browser quantum, sterling pdf, valutwarden just to name some of the services it runs easily. Paying 22p per kWh in the UK.

Anything slightly better than a potato will run all of that except the llm’s. To have a useful llm you need to spend circa £1k on a GPU and even then it won’t come close to Claude or chatgpt. Skip the llm’s for now. Just get yourself a solid little server to do everything else you need. Add dedicated hardware specifically for llm’s in future if you really want to. An old used gaming pc will be plenty for your server. I personally use Debian , but there are loads of suitable options available