• 20 Posts
  • 877 Comments
Joined 3 years ago
cake
Cake day: March 19th, 2024

help-circle



  • You’re adding negative connotations to words that have none. That’s like saying that we should rename piracy to “downloading media from alternative sources” or whatever just because corpos are anti-piracy. We use these words because they are precise and concise. Big tech is anti those words. We are pro those words. The word itself is neutral. “Sideloading” is a meaningful category because big tech makes it so by forbidding it, or making users have to use workarounds to do them. “It’s not sideloading; it’s just installing apps onto the phone you own”—well, that would be lovely, but that’s not currently the case.



  • I’m sure you’re probably right. I haven’t looked into how things like clock speed/FLOPS/etc affect LLM performance.

    The main thing is you need ROCm/CUDA/Vulkan support. If you do then just try running some models that fit into your VRAM and see how they perform? On my card, it takes maybe a minute or two to generate an answer, sometimes several minutes if the answer is long. I use small models that are <8GB in size, so not the best open-weight ones, but I don’t use LLMs for anything particularly complex anyway so the dumb ones do the trick for me.


  • Radeon RX 7600, but yes, you’re right, it’s relative. It’s good enough for any gaming I do, which is not an awful lot. I think it’s considered mid-range for its generation, I guess I was just thinking of the GPUs I see people mention they have which seem much beefier than mine lol.

    I’m no AI expert but when I looked into it, it seemed that VRAM was the biggest factor being mentioned in discussions of GPUs, hence why I mentioned it.


  • Not much, but you can use it for basically anything people use frontier models for, it’ll just be somewhat dumber. I occasionally run LLMs for proof-reading important things that I’ve already hand-written and edited. Sometimes for bouncing off ideas. Sometimes for the kinds of questions I’d normally chuck at a forum but I can get a quicker answer if I ask an LLM. No, I don’t “trust” the answers; anything where I can’t just use my own judgement, the LLM will have given me enough to perform my own research to fact-check it.




  • Divinity: Original Sin 2. Combat system isn’t perfect (my main criticism is that you can unchain your characters to set your party members up in advantageous positions and then trigger combat, which feels cheaty) but it has some cool mechanics. A lot of elemental interactions, interactions with and creation of different surfaces, factoring in high ground for an advantage, etc. I know BG3 is highly acclaimed also by Larian but I haven’t played it so can’t attest to that combat system.



  • What kind of data is it? If it can be printed, you can just print it and store it somewhere safe, or print multiple copies and distribute it around. Plenty of 80 year old books are perfectly readable. That’d only be books printed in 1946 so nothing crazy. You can pay for professional printing so they can do it on good quality paper and so on.