Then why did you say they were leftist?
As for the layoff blame, just because I say I like hamburgers doesn’t mean I hate hotdogs. Layoffs can be happening from both those things, and just because people are acknowledging one source doesn’t mean they are helping the other source…
He doesn’t care for misguided opinions not backed with anything but emotion. The people he is talking about don’t actually look into the issues and fight those, their mind is set that AI is evil and you are too for any usage of it, without actually understanding anything about the situation.
There are situations where using AI uses less power than traditional methods, there are situations where the power is clean, hell there are even models getting made that don’t use stolen data. Some people use it more responsibly (use tiny models where possible) while some toss everything at whatever new Fable or Opus is available.
There are levels of AI usage and their blanket statements with no understanding are annoying because it alienates the people that are responsible with their usage.
Maybe I am just not understanding your direction based politics, but isn’t it the right that put him in office? Isn’t your comment backwards?
To be clear, I literally don’t know, it’s hard enough following my own country’s politics lol
Thanks for mentioning that client! Just gave it a go and its probably the best client I have tried so far
Good point, could easily be hex or some higher base
5 digit user ids, yet over 700k users? Im sure they must have gone up to 6 digits
Mind highlighting the part that you think proves your point? You used some of those words, sure, but this is a completely different meaning from your original comment.
malware*
Their software contains a wiretap
Not talking about caching (though there would be some decent memory savings due to that on general platforms like ChatGPT and tools like Codex). I am talking about large batch sizes, which are concurrent requests all accessing the same memory at the same time. The model is loaded once onto the GPU(s) and then many simultaneous requests can read that memory at the same time. When those requests are all processing their responses simultaneously, the energy per token drops off a cliff.
And yes, running a smaller model would generally take less power, but thats not really a fair comparison. Small models just wont give you the same results as larger ones. You need to compare it apples to apples. If you want to compare your local Qwen model running on your laptop, you compare those numbers to larger systems supplying that same qwen model to thousands of people. Just because we are comparing cloud services to local doesn’t automatically mean GPT 5.6 vs Qwen 3.6 27B. There are plenty of cloud AI providers running all sorts of models and sizes.
As for one of the articles I learned alot of this from originally, this is one I recommend going through. It really goes deep into the whole topic: https://arxiv.org/html/2601.22076v1
Very serious. Your personal amount of usage means nothing at all in this conversation. It is entirely about tokens per watt. The amount of energy the memory operations involve scale incredibly well when people are accessing the same object in memory simultaneously. Last I looked it was around a 10x difference for the same models efficiency.
If you want me to be your personal search engine you’ll need to wait a bit, im making dinner right now and would rather look for the articles on my desktop.
You have that backwards. The only thing you gain from running local models is privacy. It is not cheaper, it is not more efficient. You are actively hurting the environment MORE by using a local model on your own. LLM efficiency sky rockets the more users there are on a single loaded model.
IMO the only way we get to efficient LLM usage would be by having very efficient non frontier models running only for its local community to use, where you can have assurances on whether its power source is clean or not. That doesn’t help with the plagiarism aspect though
Canada is the same way as the US in that regard. It’s not unreasonable to drive 150km to go to a store. Sure you stick around for a few hours or the whole day, but it is easily a short day trip.
4, 8, 15, 16, 23, 42
Firefox is a perfectly good alternative. Works just as well as chrome.
People have been doing that long before LLMs, so i wouldn’t be too sure haha
The link Axolotl replied with is it. Its a selfhosted server software that you host on one machine and access from others. You access it via its webui on your browser, and it gives you a browser based reader for all your ebook and manga files. The benefit to that is its device independent. You can pick up and keep reading from anything with a browser.
I usually download an epub of the book and put it on my Kavita server, then read from my phone.
The ui still kind of feels unpolished in commet. I tried it out two days ago, but ended up going with element instead. Just felt better to use
Yeah I just set up a synapse + livekit server last night. Voice, video, and screen share rooms work flawlessly
AI is Evil -> Irresponsible AI use is Evil AI destroys the environment -> Irresponsible AI use is destroying the environment
All it really takes imo is a small adjustment of words to change your stance from looking like zealotry to actual concern for the issues. I also think these sidetracks are important, to be fair. Otherwise we wouldn’t have had this conversation to deepen our understanding of the issues.
I would be more than willing to agree if the message was “Frontier AI labs are causing massive harm to the environment by facilitating irresponsible use of AI” rather than “AI is evil, fuck you for using it” (not saying those are your words, just getting my point across lol)